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ABSTRACT 



The purpose of this practicum was to develop a program audit handbook 
designed to assist personnel within the Chicago public schools to assess 
the operation of government funded programs in their schools, to make 
certain that they are being implemented in accordance with the design as 
funded and that they are in compliance with appropriate legislation 
and guidelines. The handbook establishes a method wherein objective 
observations, based upon those specific factors which v/ere written into 
the project being implemented, can be reviewed to ascertain the degree of 
implementation and legal compliance at the local level, prior to the 
conduct of an audit by the funding agency which could result in the filing 
of an exception and a resultant loss of funds. 
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INTRODUCTION 

The responsibility for an assessment of the level of success that 
educational programs attain has always been the duty of the chief 
administrative officer of the school system and his administrative staff. 
Regardless of how thorough the reports which are compiled and distribn'-.. ■» 
to boards of education and the public have been, the Introduction of 
federal assistance to school districts has included as a concomitant 
responsibility a strict adherence to legislation and guidelines to 
justify the expenditure of funds. 

The goal of this practicum has been the creation of a program audit 
handbook designed to assist field administrators in their efforts to 
comply with the existing regulations and at the same time to enhance their 
ability to more accurately assess the quality of the program which they 
have implemented. One of the premises embraced is that early identification 
of problem areas and timely remediaton can significantly improve the results 
of programs, i.e., programs that are implemented in fact, as well as in name, 
are more likely to be successful. 

The first chapter of this report sketches the period beginning in 1965 
when significant federal assistance was introduced to many school districts 
throughout the nation. Some of the legislation, guidelines, audit counts, 
and observations are briefly reviewed. 
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The following chapter deals with the Introduction of a program 
audit procedure within the Chicago public schools and some of the results 
of that activity. The need for a program audit handbook is also established. 

Subsequent chapters deal with the stages leading to the creation of 
the final document, the Program Audit Handbook . 
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CHAPTER I 

THE FEDERAL GOVERNMENT'S ROLE IN EDUCATION DUR ING THE LAST DECADE 

In 1965, school districts throughout the United States began to 
•incorporate into their budgets a significant number of dollars for the 
instruction of the educationally disadvantaged children, due to the enactment 
of legislation known as the Elementary and S xondary Education Act of 
1965. Although there had been other legislation which had provided 
support to public school systems, ESEA was the first to provide an amount 
which was not only significant in terms of dollars, but had the potential 
for assisting educators to make significant strides in improving the quality 
of instruction for those children suffering from economic and educational 
deprivation. Subsequent legislation has provided additional federal 
support. Included are such programs as Model Cities, funded under Title 
I Demonstration and M2trop..litan Development Act of 1965, Public Law 
89-754; Head Start, funded under Title II of the Eco-^omic Opportunity 
Act of 1964, Public Law 90-222; Neighborhood Youth Corps, funded under 
Title IB of the Economic Opportunity Act of 1964. Public Law 90-222; and 
ESAA, funded under the Emergency School Aid Act of 1972, Public Law 
92-318. Funds for the training and/or retraining of professionals and 
paraprofessionals, as well as programs in certain specialized areas 
for those interested in teaching, have been provided through legislation 
such as EPDA, funded under the Education Professions Development Act 
of 1967, Public Law 90-35. 
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The federal government began to have a substantial Impact on the 
budgets of local school districts during the mid 1960's. The total budget 
of the Chicago public schools and the federal segment of those budgets 
for the three calendar years 1964, 1966, and 1972, are summarized as 
follov/s: 

Federal Funds Federal Funds as 

Total Budget Included in Budget a % of Total Budget 

(Exhibit #1) 1964 $ 297.334,091 $ 2,097,632 .7 

(Exhibit ifZ) 1966 353,934,000 37.544,000 10.3 

(Exhibit ^!3) 1972 825,210.000 90.828,000 11.0 

Guidelines governing the operation of the various federally supported 
programs were developed and circulated to participating school districts. 
Often the guidelines were received after the program had been implemented. 
Numerous revisions ivere subsequently distributed. The guidelines were 
not only difficult to interpret in many cases, but it was virtually 
impossible for local school administrators to keep up with all of them. 
As the programs were implemented, often scant attention was paid to 
adherence to the regulations. This resulted in many "audit exceptions" 
being reported in subsequent years by federal auditors, often wUh an 
accompanying request for the repayment of funds by the local district. 
As an example, auditors for the Department of Health, Education, and Welfare 
reviewed the ESEA, Title I, program which operated in the Chicago public 
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Sources of Funding for Chicago Public Schools 

Year 1964 



Local Rinds 
$221,807606 

74.6% 




Misc. Funds 
$6,139,329 

2.1% 



.Federal Funds 
$2,097,632 

.7% 



Budget: $297,384,091 



Sources of Funding for Chicago Public Sciiools 

Ybar 1966 




Budget: $3S3,S84,000 
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Sources of Funding for Chicago Public Schools ^'>^'>^*' 

V^r1972 



State Funds 
$255,509,000 



Local Funds 
$390,947,000 

4747. 



30.97. 



Federal Funds 
.$90,823,000 



11.0% 



Misc. Funds 
$ 87923,000 

ia7% 
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Budget: $825,210,C00 
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schools September 23. 1965, to August 31, 1966, and reported, in part, 
as follows: 

Title I of the ESEA authorizes federal support to local 
public educational agencies for special programs for 
educationally deorived children in attendance areas where 
low-income families are concentrated. Its aim is to help 
broaden and strengthen education for these children. 

Federal grant funds made available to the state during 
the period of our audit amounted to $61 .5 million. 
Approximately S31. 2 million of this amount was d esignated 
for the City of Chicago. 

We have questioned the total costs incurred of approximately 
$20.5 million because the programs and projec ts as submitted 
and approved did not meet thg^regulrcr.sn ts. of the ESEA, 
Title' I. In addition, we have gues zi oiied unreported i interest 
of $177. 021. We have also q uestioned aDProxinaielySlA 
"of the $"20.5 million for additional reasons.' 



In subsequent years, other auditors from governmental agencies have 
questioned the adherence to guidelines for expenditure of funds received, 
and in some cases have demanded repayment. The district is faced with 
answering each of the exceptions in a manner which will justify the actions 
of staff who were responsible for expending the money, or to face repayment 
of the funds to the appropriate federal agency. 

Adherence to guidelines is not limiteu to fiscal concern. The General 
Accounting Office, (GAO). a federal agency which reports directly to the 
U.S. Congress, included in its report of its audit of the Chicago public 
schools and two other Illinois school districts for the school year 1969-70 
(fiscal 1970) many references to other areas. Some examples from the 
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report follow: 

Contrary to OE guidelines, hov/ever, the LEAs had not established 
measurable objectives and generally had not adopted specific 
procedures to evaluate the success of their inajor Title I 
activi tiei. 

Evaluations that were made were usually based on opinion 
surveys and teacher judanients. Although such evaluations are 
useful, we believe that'they should be supported by or used 
in conjunction with objective test data. Test data was 
obtained for some project activities, but it was not analyzed 
by the LEAs and useJ to evaluate the impact of the activities. 
Further, the LEAs had not prepared and submitted, as required, 
annual evaluation reports on program impact to the SEA. 
Consequently, the LEAs, the SEA, and other parties interested 
in the Title I program were net in a position to evaluate the 
LEAs* progra.n success, or to determine whether program 
approaches or funding levels should be revised. 2 

Objectives stated in the project applications filed by the 
three lEAs were generally vague and not expressed in measurable 
terms by type and degree of change expected. 3 

We were unable to decermine whether the average rates of 
improvement were indicative of success because the LEA had 
not established objectives for the activity in terms of the 
degree of change anticipated. ^ 

The Chicago LEA had not restricted their programs to a limited 
number of school attendance areas determined by them to be 
eligible to participate, and had not concentrated Title I 
services in those school attendance areas with the highest 
concentration of children from low-income families, and none 
of the LEAs had provided a variety of services to a limited 
number of participating children.^ 

Objections such as these have highlighted the need to see the process 
of auditing related to federally funded programs as being much more than 
fiscal control. Looking closely at the program design, its implementation 
and the eventual evaluation to assess the degree of success, is definitely 
a "program audit" responsibility. 
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Another dimension introduced into the conduct of most federally 
supported programs deals with community involvement. ESEA, Title I, as an 
example, has had a series of criteria for establishing councils. The first 
set of basic criteria, issued by USOE in the spring of 1967. called for parent 
participation, but did not define the nature of this participation beyond 
saying that it should be "appropriate."^ The second set of criteria, 
issued in the spring of 1968. called specifically for involvement of parents 
"in the early stages of program planning and in discussions concerning the 
needs of children. "7 On July 2. 1968. USOF issued a separate memorandum 
on parental and community involvement stating that "local advisory committees 
will need to be established."^ 

Although much is left to the local educational agency, the need for a 
diligent program audit activity within a school system has become a growing 
need. The broad range of legislation, guidelines, bulletins, schedules, 
and reports demands a level of sophistication never before required. The 
Chicago public schools have moved to fill the void through the use of a 
program audit procedure initiated and conducted by the Department of 
Government Funded Programs. 
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CHAPTER II 
AUDITING FEDERALLY FUNDED PROGRAMS 

Since July 1971, in response to a request from the Assistant 
Superintendent, Department of Government Funded Programs, staff has been 
conducting an ongoing internal program audit of those programs managed by 
this department. 

In general, the major objectives of the program audit are as follows: 

, To observe programs to determine if they are being 
implemented in' accordance with the approved contract 
or grant award. 

To transmit information concerning audit exceptions 
to the appropriate line officer so that discrepancies 
can be corrected. 

To obtain input from field personnel in order that program 
guidelines might be developed which are consistent with 
contractual limitations and helpful to successful program 
implementation. 

It is important to understand that under the Chicago school system's 
administrative decentralization plan, which was developed by the management 
consulting firm of Booz, Allen, and Hamilton, the Department of Government 
Funded Programs has no responsibility for, or authority over, actual operation 
of programs. That was shifted to regular line administrators as part of 
their regular administrative tasks. The decentralization plan envisioned 
the central office Department of Government Funded Programs as a service uniw, 
performing such roles as searching for funding sources for proposals initia^cd 
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at the local school, district, or area levels; putting applications into 
proper format in accordance with guidelines; preparing applications; and 
furnishing the field with br,y technical help needed.^ 

Evaluation was also viewed as one of these service functions. As a 
first step toward program audit, a survey of the adequacy of implementation 
was built into the end-of-the-year evaluation of fiscal 1971 (school year 
1970-71) Title I programs. 

A 40-question interview was developed, field-tested, and reduced to 
15 questions. Staff evaluators administered these questions to the 
principals of 148 schools with basic reading activities, representing 
three-fifths of the schools with Title I programs. The evaluators also 
visited classrooms for observation of programs in operation. 

The questions covered such things as grouping patterns for each 
activity, the amount of teacher experience, the frequency and types of 
inservice meetings, the degree and quality of parental involvement, 
whether programs started on time, whether space was adequate, and whether 
equipment and materials were received promptly. 

The results delineated for each activity covered the weaknesses and 
strengths in implementation. They were summarized in an evaluation report 
showing that Title I programs indeed were checkered with implementation 
breakdowns— which many principals found impossible to deal with from 
their particular vantage point in the school system. 

For example, audit of one $1,700,000 reading program, producing 
student test scores little improved over those from regular programs. 
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revealed that in 40 percent of the participating schools the program was 
a month or more late in getting started. About 25 percent of the 
principals reported that they had not received major equipment four to six 
months after the school year started. Thirty percent said they were still 
lacking special materials by that time, and some were still waiting for 
parts of orders in March. But the major factor blocking full implemen- 
tation, the principals said, was difficulty in obtaining staff, both 
professional and paraprofessional .^^ 

The ongoing audit covers all federally funded programs. To carry this 
out, the department added only one new staff member, an audit coordinator, 
whose salary is 40 percent government funded and 60 percent locally funded. 
The people who make up the auditing teams under the direction of the 
coordinator were on the government funded staff v/hen the auditing idea 
arose— conducting research, assisting in proposal writing, negotiating 
contracts, and perfonning other tasks which made them alv-eady familiar 
with guidelines and other aspects of federal programs. Only limited 
training and preparation of auditing forms were necessary to get them started 
on program monitoring, which they now do in addition to their other regular 
duties. 

Early in the developmental year (school year 1971-72), the audit was 
divided into phases, with each phase designed to check on some particular 
aspect of implcmontation. In the initial phase, auditors interviewed 
principals to find out whether staffing was complete, materials and supplies 
had been ordered and received, and pre-testing was finished. 
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Phase 2 of the audit focused on whether programs were actu^ll:^ being 
operated in accordance with program guidelines. Auditors visited every 
class of every government-funded program in each school. 

Audit schedules are distributed each week to government funded staff 
iTfimbers by the audit coordinator. Members usually visit schools in teams, 
and meet beforehand to review program guidelines and audit checklists. 
Principals are notified in advance before the initial visit, but not 
thereafter. Visits usually last one to two hours at each school. Recently 
field personnel have been added to the audit teams, but they do not 
monitor programs they themselves direct. 

Each auditor files a report inmediately upon his return to the central 
office. Discrepancies or problems are reported in writing to tlie assistant 
superintendent for government funded programs, who notifies the field 
administrators accountable for the programs involved. It is up to the field 
administrators to initiate corrective action at the program level. The 
auditors' role is to gather information only. They have no autliority to 
order changes, although local schools may call upon them for help in the 
interpretation of guidelines and/or program goals and requirements. 

As a result of the audit procedure, many problems experienced with 
programs currently in operation are now reported in time for corrections 
to be built into proposals for the next year. In the past this was often 
.a two-year process. Problems came to light in the central office— if at 
all-in July or later when the year-end evaluation had been compiled and 
distributed. Cut this was after proposals for the coming schoCil year 



14 



had already been prepared for submission to the state for approval. 

In a letter directed to the Board of Education of the City of Chicago 
dated June 19, 1973, the General Superintendent of Schools, Dr. James F. 
Redmond, stated that, "In general, it appears that guidelines for 
most government- funded programs are better understood by personnel 
responsible for implementing programs and are being more closely complied 
with than in previous years. In most cases, delayed implementation of 
activities occurred in new programs. It is expected that as these programs 
become operational for a second year, these problems will not reoccur. The 
program audit staff in the Department of Government Funded Programs operated 
independently of the program staff responsible for providing technical 
assistance in program development and school staff responsible for the 
implementation of the program. This approach has proved to be a successful 
internal procedure resulting in a decrease in the number of contract 
violations." 

Although the Department of Government Funded Programs, serving as the 
independent internal program auditor for the school system, must retain 
its role, it is anticipated that improved understanding of the need and 
process of the activity by all members of the administrative force will 
further improve the performance of federally funded programs within the 
Chicago public schools. 

Further, if this activity is worthwhile and successful, it sho'.ild be 
made available to other school districts and perhaps used for locally 
funded programs as well; hence the desirability of creating a program 
audit handbook. 
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CHAPTER III 
THE STRATEGY 

A great deal had been learned since the audit program was initiated 
in 1971. Improvement in program implementation has been realized. Fewer 
audit exceptions have been received from funding agencies. However, it 
was concluded that the development of a program audit handbook would 
further reduce the number of audit exceptions and improve the conduct and 
accomplishemnts of programs currently in operation which are financed with 
funds from various governmental sources. 

Therefore, the assistant superintendent moved to establish a com,Tittee 
charged with the responsibility of drafting a document on program audit. 
It was envisioned that the handbook would be of benefit not only to personnel 
within the Chicago public schools, but to administrators and staff in many 
other communities. 

The committee v/as comprised of persons from the Departmsnt of 
Government Funded Programs, staff from the field units, representatives of 
other governmental agencies, and parents who served on citywide advisory 
councils. The Chicago public schools are divided into three administrative 
areas; therefore, the necessary conYTiuni cation was prepared and sent to the 
three area associate superintendents asking them to designate a district 
superintendent, a director, and a principal to serve. (See Exhibit #4.) 
The central office staff v;as solicited from within the department on a 
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Exhibit #4 

BOARD OF EDUCATION 

CITY OF CHICAGO 
228 North LaSallc Street 
chicago. illinois 60601 

TKLKTHONK e4t^t4t 

James F. Redmond 
mc9 q. moffat wthmat •ope«intemo«nt of schools 

•ItTANT •U^rR)NTCNOCNT 
WMNMCNT ruNOCa PMOORAMt 

ELIPHONC 64t.4S0O 



September 27, 1973 



Dr. Curtis C. Melnick Mr. McNair Grant 

Area A Associate Superintendent Area B Associate Superintendent 

Dr. Angeline P. Caruso 

Area C Associate Superintendent 

Dear Colleagues; 

The Department of Govjrnment Funded Programs is planning 
to develop a handbook to assist administrators in understanding the 
program audit activities. The handbook will be based on procedures 
developed and implemented during the past two years in the Chicago 
public schools. 

Although the primary thrust will be to assist administrators 
within the system, it is the intent to create a document which will be 
useful to administrators in other school systems throughout the nation. 

I would appreciate having representatives of your staff serve on 
this committee. It would be helpful if a district superintendent, a 
director, and a principal could be nominated. I feel that input from 
field personnel is important in this endeavor. 

I appreciate your cooperation.r 



JGM:cp 
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voluntary basis, and the community person was nominated by a director 

from within the department. After some preliminary contacts, 

the assistant superintendent determined that the representatives from 

other governmental agencies would serve on a "call" basis rather 

than as permanent members because a significant commitment of 

time was involved and some of the persons who had the most experience in 

the audit function were not available for full participation. 

The first meeting of the General Committee was held in October 1973. The 
committee had a membership of 31 persons (see Exhibit #5). The Administrator 
of Program Audit. Department of Government Funded Programs, was selected 
to serve as co-chairman while the assistant superintendent served as 
chairman. A review of the program audit activity since its inception in 
1971 was presented by the staff. This was followed by a discussion of the 
charge to the committee, the development of a program audit handbook, and 
a review of suggestions as to how to proceed. 

It was determined that each member was to review his files and send 
to the secretary those items which might prove helpful in the creation of 
the document. In addition, the submission of any suggestions for content 
was encouraged. Because of the size of the group, a Coordinating Committee 
was appointed. Further, it was decided that a sub-committee v;ould do the 
initial writing, end that the remaining members would serve as a nucleous 
for the evaluation of v/hat was produced and would assist in v/orking with 
personnel throughout the system in evaluating the draft 9«; it was developed. 
Additional sub-committees for Data Collection, Graphics, and Evaluation 
were appointed. In all, five sub-committees were organized (sec Exhibit US), 
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Exhibit §S 

COMMITTEE 
PROGRAM AUDIT HANDBOOK 



Chai nnan 

Assistant Superintendent 
Government Funded Programs (1) 

Co-Chairman 

Administrator* Program Audit 
and Proposal Review (2) 



Administrator 
ESEA Title I Lanauage 
Development Programs 



(3) 



Administrator 

ESEA Title I Program Planning (4) 



Administrator 
Research and Evaluation 



(5) 



Administrator 

Special Programs Development (6) 
Coordinator 

City Program Coordination (7) 



Coordinator 

Data Analysis* Research 
and Evaluation 



(8) 



Coordinator 

Editorial and Coni'iiuni cation 
Services (9) 

Coordinator 

State Program Coordination (10) 

Director, Bureau of School Systems 
USOE, Departr^.ent of HEW 

Director 

ESEA Programs, Area A 
Director 

ESEA Programs, Area B 

Director of Co:^'J!iunity and 
Human Relations, Area C 



Director 

Early Childhood Programs 



(11) 



Director 

Special Programs U^J 

District Superintendent 
District 7 

District Superintendent 
District 21 

District Superintendent 
District 23 



Principal 

Beethoven Elementary School 
Principal 

Donoghue Elementary School 
Principal 

Webster Elementary School 

Staff Assistant 
Editorial and Communication 
Services 

Staff Assistant 
Editorial and Communication 
Services 

Staff Assistant 
Model Cities Programs 

Staff Assistant 

Program Audit and Proposal Review 
Staff Assistant 

Program Audit and Proposal Review 

Staff Assistant 
Research and Evaluation 

Staff Assistant 
Research and Evaluation 

Staff Assistant 
Research and Evaluation 

Parent 

ESEA Title I Advisory Council 



(13) 

(M) 

(15) 

(16) 

(17) 

(18) 

(19) 

(20) 
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E;;hibit #6 

SUBCOMMITTEES FOR PROGRAM AUDIT HANDBOOK 



Coordinating Conimittee 

Assistant Superintendent 
6overnn".ent Funded Programs (1) 

Administrator, Program 
Audit and Proposal Review (2) 

Administrator 
ESEA Title I Language 
Development Programs (3) 

Administrator 

Special Programs Development (6) 
Director 

Early Childhood Programs (11) 

Staff Assistant 
Editorial and Communication 
Services (13) 

Staff Assistant 

Research and Evaluation (19) 
Evaluation Committee 
Administrator 

ESEA Title I Program Planning (4) 
Administrator 

Research and Evaluation (5) 
Coordinator 

State Program Coordination (10) 
Staff Assistant 

Research and Evaluation (20) 

Graphics Contiittee 

Coordinator 

City Program Coordination (7) 

Staff Assistant 
Editorial and Communication 
Services (14) 

Staff Assistant 
Proposal Djvclopi'.ent and 
program Audit (17) 



Data Collection Committee 
Coordinator 

Data Analysis, Research 
and Evaluation 

Staff Assistant 
Model Cities Program 

Staff Assistant 
Proposal Development and 
Program Audit 

Staff Assistant 
Research and Evaluation 

Writing Conmittee 

Administrator 
ESEA Title I Language 
Development Programs 

Coordinator 

Editorial and Connuni cation 
Services 

Director 
Special Programs 

Staff Assistant 
Editorial and Comnuni cation 
Services 
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There was also discussion of the format for the document. There was 
some feeling that in addition to the handbook, which might be quite lengthy, 
that a brochure also be published which would, in capsule form, give 
the highlights of the audit's purposes and procedures. This idea was tabled 
to be considered at a time following the distribution of the handbook. 
The writers indicated they would develop an outline and present it to the 
conwittee at its next general meeting. 

In addition, a number of specific questions were raised during the 
conduct of the meetings. The Coordinating Committee developed responses 
to questions of: 

1. Why audit? 

2. Who has the initial responsibility for audit? 

3. What should auditors do? 

4. What programs or activities should be audited? 

5. What factors seem to cause poor program Impler-ipntation? 

6. What does Research do? What does Audit do? 

7. How can administrators change guidelines? 

The responses were shared with all members of the General Committee. 

At the outset, the assistant superintendent recognized that if a 
quality document was to be produced, funds would need to be identified 
to cover sone of the costs involved in completing the project. The major 
concern was for fuiids to cover the costs of printing and related activities. 
Therefore, a proposal was developed to be sent to potential funding sources 



ERIC 



21 



(see Appendix #1). The proposal was submitted to the Board of Education of 
the City of Chicago on September 25, 1973, in a report entitled, "ESEA 
Title III Mini-Crant Proposal Submission: Program Audit: A Move Toward 
Accountability." (See Exhibit #7.) The board approved the proposal and 
it was subsequently sent to a number of governmental agencies and foundations. 
In addition to Tit'e III, for consideration. 

The Chicago Community Trust, a charitable foundation created to 
accept and administer gifts under wills or living trusts for health, 
welfare, educational, and artistic purposes, awarded the Chicago public 
schools a grant of $9,100 to assist in the development of the handbook. 
The award was accepted by the Board of Education on January 23, 1973 (see 
Exhibit #8). 

The grant, coupled with the efforts of the regularly assigned staff, 
was sufficient to cover all costs related to the project. 

The strategy had now been established. The subsequent chapters deal 
with the specifics of conducting the project. 



73-1076 10 



Scptenbcr 25, 1973 
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Exhibit #7 



^^COMMENDATION: 



ESEA TITLE III MINI-CRAIIT PROPOSA'u GUEMISSICN; 
PROGRAM AUDIT: A MOVE TCWi\RD ACCCUirrABILirf 

BEST COPY AVAILABLE 

Approve subnlsslon to the Office of the Superintendent of Public 
Instruction of PRCCm AUDIT: A KOVE TOWARD ACCOUNTABILITY , a 
proposal for funding under the ESE/* Title III Mini-Grant pro6ran 
or other ivpproprintc sources. A copy of the proposal is on file 
In the Office of the Secretary. 

This pioposal seeks funding to provide a ouality educaMonal 
progran through r..orc effective and efficient internal progran audit 
procedures resulting fron the devclopnent and publication of a 
cocprchensivc handbook. 

SUPPORTIVE DATA: The ESEA Title 111 Mini -Grant was developed as a strategy for 

pronoting educational change. Mini-grants differ fron nomal 
ESEA Tife III pragrans in that the naxinua grant is lintted to 
$10,000, the application is greatly ^inplificd and United to ten 
pages, and the naxinun project period is one year. 



DESCRIPTION: 



"INANCIAL: No additional cost lo the Board of Education, 

A oaxinun of $10,000 will be sought fron funding sources* 



Respectfully subnitted, 
Jims F. REDMOND 

General Superintendent of Schools 

'repared by: 

CLIFFORD CLAIBCISNE, Adninistrator, ESEA Title III 



\pp roved by: 

4.0YD J. IIE^IDELSON, Director, Bureau of Special Prograns 

TAMES G. KOFlWr, Assistant Superintendent, Govertmcnt Funded Pro grans 

.lAlHtORD BYRD, jr.,, Deputy Superintendent of Schools 



:3tcd : 

■OBERT STICKLES, Controller 
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January 23, 1*^74 
GRANT AI^ARD: PROGRAM AUDIT: A MOVE TWARD ACCOUNTABILITY 



RECOMMENDATION: 



DESCRIPTION: 



SUPPORTIVE DATA; 



Accept with the appreciation of the Board and staff a grant award 
In the amount of §9,100 frora the Chicago Community Trust for 
PROGRAM AUDIT: A MOVE TOWARD ACCOUNTABILITY. 

Authorize implementation of the project. 

PROGRAM AUDIT: A MOVE TWARD ACCOUNTABILITY is a proposal for 
the development of a comprehensive program audit handbook. 

One of the major responsibll itiea of the Department of Government 
Funded Programs is the monitoring it educational programs^ funded 
through nonlocal sources. The purpose of the handbook, therefore, 
la to Improve program audit procedures within the Department of 
Government Funded Programs and to share with other school -.teas 
and interested agencies the successful monitoring methods and 
procedures developed by the department. 

Board Report 73-1076-10, dated September 25, 1973, approved the 
submission of this proposal to funding sources. Staff submitted 
the proposal to the* Chicago Community Trust and, on January 2, 
1974, v/as notified that its executive committee approved an awar»l 
of $9,100 for the development of the handbook. 

Fully reimbursable under provisions of the grant. 

Charge to the Department of Government Funded Programs, 9, 100 — 
accounting classification: 361-1-999-94; accounting dlstrlbuuica: 
361-6-275-obJ. 

Respectfully submitted, 
JAMES F. REDMOND 

General Superintendent cf Schools 



Prepared by: 

MICHAEL r. QUINN, Coordinator, City Program Coordination 
Approv2d by: 

RICIL\nD TYGinr.SICI, Director, Dc7'.rtir.en--il Prc[;ra;:i Coordini^-.ion 

JAMES G. KOI-TAT, Asdstant Superintendent, Govorniront Fun-t.td Pro.-rn-j.. 

MANFORD BYRD, JR., Deputy Suporintendn.-.t of Schools 

Within approprlntlon: 
ROBERT STICKLES, Ccntrolior 



FINANCIAL: 
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CHAPTER IV 
DEVELOPIUG THE HANDBOOK 



At the next meeting of the General Conniittee a review of the progress to 
date was conducted. The principal business of the day was the review of 
the outline for the handbook, which had been prepared for the Writing 
Sub- commit tee. Considerable discussion followed. The committee accepted 
the following design: 



PROGPJ\M AUDIT HANDBOOK 

I . Preface 

II. Introduction 

A. The role of the Department of Government Funded 
Programs 

B. Objectives of Program Audit 

1. Why Audit? 

2. Our obligations to funding sources 

3. Our obligations to government regulations 
and guidelines 

4. Auditing as an opportunity to improve 
programs 

C. Scope of Program Audit 

1. What is audited? 

2. What is not audited? 

III. Audit Procedures 

A. The auditors 

1. Who are they? 

2. How are thoy selected? 

3. What is their function? 
6. Preparing for the audit 

1. Inservico of auditoi-s 

2. Familiarity with the programs, the schools, 
and the audit report forms 
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C. Visiting the programs 

1. General routines 

2. Professionalism during the visit 

D. Preparing the audit report 

1. During the visit 

2. Review of report after the visit 
fc. Types of audits and their frequency 

1. Initial audit 

2. Comprehensive audit 

3. Special audit 

IV. Audit Exceptions 

A. What i? an audit exception? 

B. Report of audit exceptions 

1. To whom are the reports sent? 

2. Whdt are the channels of corranuni cation? 

C. Responsibility for correcting the exceptions. 

V. Results of Auditing 

A. Prompt and efficient implementation of programs. 

B. Possible changes in organization of programs 

1. In the schools 

2. In the Department of Government Funded 
Programs 

C. Possible improvement in educational worth of 
the programs 

VI. Appendix 

A. List of Government Funded Programs 

B. Guidelines for Government Funded Programs 

C. Forms used in Program Audit 

The members agreed that the outline would be reviewed and revised, 
as appropriate, throughout the conduct of the project. To assist all 
members of the group in understanding the format which has been used by 
auditors, a copy of the program Audit Checklist was distributed (see 
Appendix #2). 
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Brief reports were presented by the convenors of the other sub- 
committees. The members were satisfied that everything was moving along 
well, and a target date of January 11, 1974, was established for the 
completion of the draft of the handbook. This would permit distribution 
for review and return of a questionnaire on or before January 31, 1974. 

As previously indicated, the Coordinating Committee was responsible 
for planning and preparing the document. This committee was chaired by 
the Administrator of Program Audit, as appointed by the assistant 
superintendent. Meetings were originally scheduled on a weekly basis, 
but as the work intensified, meetings were held almost on a daily basis 
for a brief period. 

The work of the Coordinating Comnittee and other sub-committees was 
shared with the General Committee through correspondence and regular 
monthly meetings. The General Committee at its monthly meetings assisted 
by making recommendations regarding the directions the project should 
take, by serving as a bounding board, and by reacting to the agenda and to 
the materials prepared. 

The assistant superintendent provided continuous leadership by attending 
committee meetings, requesting and examining coirmittee progress reports, 
and making recommendations to tf.e committee as the project progressed. A 
very important aspect of this leadership included a priority assignment 
to the project, thus allowing committee members full availablility of 
department services. 
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Each sub-committee chairman aligned priorities with comnittee members 
so they could assume a portion of the required tasks in concert with their 
regular duties. 

In their search and appraisal of materials, comnittee members examined 
documents found within the department. These included materials from 
Model Cities/CCUO, the bilingual education program* and the Division of 
Research and Evaluation. Inasmuch as all members of the department were 
aware of the project, they cooperated in providing information which they 
felt would be helpful. 

During the actual writing of the manual, comnittee members shared 
their opinions and recomnendations. All were considered, critiqued, and 
correlated into a field test copy of the manual which the committee felt 
should be developed and circulated with a questionnaire to a random sample 
group of administrators both within and outside of the Chicago public 
schools. This process, while time-consuming, was valuable. Open 
communication was maintained throughout the processes of acting, reacting, 
and interacting among committee members and resulted in the accomplishment 
of the task. 

The General Committee received copies of the materials as they 
were prepared. This permitted additional interaction and opportunity for 
input. 
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CHAPTER V 
WRITING SUBCOfMITTEE 

The sub-coiranittee charged with writing the document consisted solely 
of staff members from within the Department of Government Funded Programs. 
This decision was made by the assistant superintendent based upon the 
assumption that a significant amount of time would be devoted to writing, 
frequent meetings v;ould need to be held with members of the committee, 
and members of the general committee who were assigned to the field would 
have difficulty in attending hastily caUed sessions. In addition, there 
was a significant amount of work to be done in the field for which these 
members were better suited, all factors considered. 

During the initial meeting of the Writing Sub-Committee, it was 
determined that throughout the life of the conmittee the involvement of 
other members of the department would be desirable. Various members 
participated for a limited time to share their expertise. 

The members addressed themselves to the task of critically assessing 
"where v/e are - and to plan for "where we are going." 

It was concluded that the Department of Government Funded Programs 
has initiated and developed program audit techniques to ensure that 
government funds are expended within contract guidelines, to decrease the 
number of audit exceptions, and to improve the educational programs available 
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to participating children. The task at hand was to develop a handbook 
which would serve as a vehicle to share what had been learned through the 
audit activities, to assist interested persons to improve their understanding 
of audit techniques, the reaso ia for auditing, pitfalls in implementing 
programs, and how to seek assistance as necessary. 

The discussion also covered the timeline for completing the document, 
how audit report data might be computerized, and how the field personnel 
would be involved throughout the life of the project. An outline for the 
handbook evolved from the discussion. A member of the sub-committee 
assumed the responsibility for developing the outline to be shared with 
the General Committee. This outline was reviewed and modified at the 
next sub-committee meeting and forwarded to the General Conmittee for 
review and approval as previously discussed. 

During subsequent meetings, each chapter of the handbook was developed 
and critiqued. Various approaches, definitions, and directions were 
discussed. As an example, the need for a definition of program audit 
resulted in the development of the following three possibilities: 
1. The professional staff of the Department of Government 
Funded Programs visits sites, interviews principals and 
staff members, observes the status of program implementation 
and operation, and collects and records this information 
on an audit form. The audit staff reviews the data to 
ensure that the activity is operating in compliance with 



the approved project narrative. Exceptions, if any, 
are reported to appropriate line officers (and the 
department staff) with a request that the department 
be notified as to how and when the audit exceptions have 
been corrected. 

A program audit is an on-site examination, by trained 
personnel, of operative educational projects to ensure 
their compliance with established goals, objectives, and 
procedures. 

Especially for government funded programs, the audit is 
a functional necessity. Government agencies demand strict 
adherence to guidelines— the economic or educational 
deprivation of the children served, the ratio of teachers 
and paraprofessionals to children, the number and type 
of inservice meetings, the involvement of parents and 
community, the use of materials and equipment, and the 
dissemination of information about the educational 
approach~-all are explicit in the contract entered into 
by the local educational agency and the funding source. 
That contract, like all other contracts, is an agreement 
which is binding upon all those who enter into it; therefore, 
care must be exercised in the implementation of the terms 
it contains, and it is the responsibility of the local 
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educational agency to monitor programs and to note exceptions 
wherever they occur. 
3. Program audit is a method whereby essential elements needed 
to properly implement a program in accordance with guidelines 
of a funding agency, and the approved proposal prepared by 
and/or selected by a unit, are defined, analyzed, and 
classified under appropriate components so that they 
might be examined at the site where the project is in 
operation by an impartial team of auditors. Consideration 
Is then given to reviewing the information acquired in 
order to correct any discrepancies or exceptions and to 
determine those discrepancies which happen on a recurring 
basis so that they might be avoided \^f^th proper planning. 

Inasmuch as the handbook was being developed for use in other school 
districts in addition to Chicago, careful consideration was given to each 
area to make certain that the materials were not too specifically related 
to the Chicago public schools. However, the thrust of the narrative was 
addressed to the local system, with encouragement to other districts to 
modify the design as appropriate to meet their needs. 

The sub-committee continued to work on the writing of the document 
throughout the months of October, November, and December 1973. Plans were 
formulated to "field test" the document during the month of January 1974. 
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Three members of the Evaluation Sub-Committee were assigned the task 
of developing a questionnaire to be used in conjunction with the "field 
test" of the handbook. Questions which required a response on a multiple 
choice basis were included, as well as open-ended requests for suggestions 
which would g"'ve specific recommendations as to how the handbook could 
be improved. When the draft copy of the handbook and the questionnaire 
were completed, the assistant superintendent wrote a letter of transmittal 
addressed to the two hundred administrators from within and outside of the 
school system who had been randomly selected, soliciting their cooperation 
in reviewing the document, completing the questionnaire, and returning it 
(see Appendix #3). 

Of the two hundred questionnaires v/hich were distributed, 92, or 46 
percent, were returned. The suggestions included were carefully considered 
by the sub-comnittee and adjustments in the narrative and format were 
made, as appropriate. An analysis of the responses to the questionnaire is 
included in the section on the work of the Evaluation Sub-Committee. 

The final copy was then ready for printing and was forv;arded to the 
Graphics Sub-Comniittee which had been working on the layout design. 
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CHAPTER VI 
GRAPHICS SUBCOmiTTEE 

The Graphics Sub-Conimittee was charged with the responsibility of 
reviewing the possible layouts, format, photographs, materials, and colors 
to be used for the publication. 

The Graphics Sub-Committee met on eight occasions to select graphics 
and to develop the layout for the handbook. Informal meetings were also 
held on occasion to discuss problems as they arose. 

The sub-committee reviewed the narrative which had been prepared and 
studied a large variety of manuals and illustrated materials to choose 
the kinds of illustrations best suited to the narrative. The sub-conmittee 
looked at many brochures, magazines, and reports to ascertain the most 
appropriate and attractive layout possible, and also to determine the most 
adaptable format for the handbook. 

The size and style, as well as the layout, of the handbook were 
discussed by the Graphics Sub-Cooittce and a number of alternatives were 
selected to be presented to the General Con.,Tiittee in order to allow them 
choice in such areas as the size of the document, quality of the paper, 
type style, and color to be used. After these determinations were made, 
the sub-committee selected the illustrations to be included and planned 
one final layout for the document. 
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The following decisions were ultimately made: 

1. Size of manual will be S'i x 11. The color of the cover 
will be a vivid blue with a contrasting second color. 

2. The cover will consist of two parts - regular cover 
stock with a plastic overlay going halfway across 

the front. The plastic overlay will be of contrasting 
color to the vivid blue. 

3. The color theme will be carried throughout the page 
borders of the manual . 

4. Black and white photographs depicting "A day in the life 
of an auditor," related specifically to the narrative, 
will be used throughout. 

One of the most important decisions which had to be made by the 

sub-comni ttee was the type of illustrations to be used. The alternatives 

considered v/ere: 

. a symbol related to the audit function which would be repeated 

throughout the manual as appropriate 
. a series of drawings related to the .narrative, depicting 

auditors, teachers, pupils, and material Thebe could be 

produced in either black and white or in tones 
. a series of black and white photographs relating to the 

narrative. 

In weighing the alternatives, the sub-coirmittee considered cost, 
attractiveness, purpose, and relevancy. Relative costs were reviewed and 
a number of artists were contacted for assistance in determining the type of 
illustrations which would be most attractive and suitable to the copy. 
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Based on the input received, black and white photographs were chosen 
for the following reasons: 

. a symbol would not be as attractive and would tend to be 
mono ton ou<: 

. black and white line drawings are costly, used cotnmonly, 
and, therefore, unimaginative 

. toned line drawings are very expensive in both artist's cost 
and reproduction (estimated cost for a professional illustrator 
was about $1,200 using a rate of $15.00 per hour and an 
approximate time of 10 days - this cost is for line drawings 
only and no other graphic work) 

. colored photographs were not considered since they are very 
costly to reproduce and do not reproduce v/ell 

. black and white photographs v/ere less expensive than line 
drawings, and they allow for a wider selection since many can 
be taken in a short period of time. This makes it possible 
to relate the illustrations to the narrative in a very 
consistent manner. Photographs also are more realistic than 
line drawinns and create a more vivid impression on the 
reader. Moreover, they can be changed more readily as the 
document is revised. 

The final task for this sub-comir.ittce was the mechanics of getting 
the handbook printed. In accordance with the policies of the Board of 
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Education, a requisition was prepared and printing specifications were 
drawn up to be circulated to printers (see Exhibit #9). The Bureau of 
Purchases circulated the bid solicitation and ultimately awarded the work 
to the second lov.est bidder. In order to remain within the budget which had 
been established, 3,500 copies were ordered at a cost of $8,960. 
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CONTACT KAREN 



PRINTING sPKCii ICATIONS BEST COPi AwfllLABLE 

J. ROTH, (312) 641-4573, FOR APPOINTMENT TO VIEV7 MOCK-'J^ 



. TITLE 

QUANTITY 
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SIZE 



STOCK 



COPY 



COLOR 



HALFTONES 

LINE COPY 
TO BE 
PROVIDED 
BY PRINTER 



SPECIAL 
REQUEST 
OF PRINTER 

BINDING 

PROOFS 



Program Audit Manual 
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72 pages text; 2 fcovcrs 
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Board of Education 

Department of Government Funded Programs 
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CHAPTER VII 
DATA COLLECTION SUBCOmiTTEE 

In order to establish the mechanics of logging data on audit findings, 
a Data Collection Sub-Committee was established. The General Committee 
felt that a computerized data bank should be established to assist in 
the analysis of the data collected in the reviews conducted at the schools. 
This system would also provide the wherewithal to compare data collected 
one year against data which had been collected in previous years, in order 
to determine the improvement in implementation at a particular site as 
compared to the implementation in previous years and to identify areas 
which continued to need attention, or to identify new problems which may 
have arisen. 

Since the beginning of the audit program, during the 1971-72 school 
year, a variety of forms had been developed and refined for the 
col lection" of information. From the content of these completed forms, 
reports were developed for the assistant superintendent to distribute to 
the appropriate line officers. However, weaknesses surfaced as the 
committee reviewed the procedures previously employed. The data gathered 
had never been fully evaluated to ascertain the frequency of some of the 
audit exceptions, nor had a procedure been established so that a school 
unit's performance, over a period of years, could be assessed. 
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Some exceptions which had a' negative effect on program success were 
quite obvious. Late staffing, lack of materials, and a shortage of 
supplies were frequently noted. Other factors were not so obvious. 

Therefore, the sub-committee was charged with the task of developing 
a computerized system to assist in the evaluation of the programs in 
operation on an ongoing, comparative basis. 

In 1971 the need for a structured questionnaire to be used by auditors 
which would assist in the retrieval of data was immediately apparent. 
Staff proceeded to devise questionnaires of various types. Included were 
checklists which required only a "yes" or "no" response, open-ended 
questionnaires which required a narrative answer, and combinations of the 
two. The types of data which the auditors collected were consistent, but 
various forms were used in an attempt to determine which provided the 
most accurate and objective information. Samples of these instruments 
may be found in Appendix U. 

Perhaps because a structured program audit was a new concept In the 
Chicago public schools, continuous articulation between auditors and line 
administrators was required. Therefore, initially the most successful 
form was the open-ended questionnaire which required a narrative response 
to ' .tually all items to be covered other than attendance and enrollment. 
Forms of this type, specifically tailored to the guidelines of the various 
funding agencies, were developed and used during the 1971-72 school year. 
(See Appendix #5.) 
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As the auditing function continued and staff became familiar with 
agency guidelines and regulations for programs other than those for which 
they had a day-to-day responsibility, it became apparent to them that 
there were many similar requirements within n.ost programs, 

A general questionnaire, therefore, was developed for use during the 
1972-73 school year for auditing most government funded programs. It was 
designed to check to determine if staff had been assigned to the school 
by the Department of Personnel, whether the staff was assigned within the 
school in keeping with the guidelines for the program, whether the accounting 
procedures were correct; whether materials, equipment, and supplies had been 
properly ordered, charged, and delivered; and whether areas of community 
Involvement, staff development, dissemination of information concerning 
the program, and other items commonly mandated by the funding agencies had 
been adhered to during the course of the program. The auditor v;ould sit 
with the principal and assist In the completion of the questionnaire (see 
Appendix #6). 

In addition to the general form, two other kinds of forms were utilized. 
Since the initial visit to a program was to determine If the program had 
begun. on time v/ith proper staffing and materials, and did not include 
classroom observation, a short questionnaire v/as developed for this purpose 
which could be completed quickly so that deficiencies could be quickly 
corrected. Another questionnaire was developed for programs having very 
specific agency requirements. Head Start, funded by the Office of 
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Economic Opportunity and the State-Supported Bilingual programs, are 
examples. In most instances the responses required on all of these forms 
were of a narrative nature. (See Appendix #7.) 

In 1973, the forms were revised because areas were Identified for which 
Information was not available under the system in operation as follows: 

1. There had been no specific question concerning the supplemental 
nature of programs. Most funding is based on adding to the 

local district effort. Substituting for local funds (supplanting) 
is a violation of these reyulatlo'^s. Therefore, a question 
was added to cover this concern. 

2. A provision for checking the accuracy of position accounting 
of funded personnel was added. A random interview with four 
funded personnel was held by the auditors during the classroom 
observation portion of the audit to verify that they were 
being charged to the correct position number and were engaged 
in the activity or program to which they were officially 
assigned. 

3. At least four pieces of equipment were spot checked against 
the inventory on each visit. Findings were included in the 
audit report. 

4. Items relating to community involvement and staff development 
were made more specific. 
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5. The basic questionnaire was redesigned in chart form requiring 
less narrative, but with a space at the end of each section 
for comments. 

6. The one-page classroom observation form was expanded to 
include all programmatic aspects of the activity. It was 
printed on "no carbon required" paper with an original and 
three copies so that administrators might have immediate 
feed-back concerning findings and compliance. 

The desirability of computerizing the data collected through program 
audit has become increasingly evident. More persons have requested 
specific data on a regular basis. More important, audit data collected 
over several years can be used to ascertain if exceptions have decreased, 
have remained consistent, or have become more severe on a comparative 
basis. Such data will be helpful as a basis for future planning. 

The sub-committee which had been appointed to work on the computer 
program began by making a thorough investigation of all audit forms which 
had been used since the inception of the audit program to determine the 
common areas of information which had been collected. 

A procedure was then devised to code the information from the current 
audit form for computerization. The steps undertaken were: 

1. The audit form v/as revised (see Appendix jl'8). 

2. An Audit Management Information Form and a Key for Recording 
Audit Exceptions were prepared (see Appendix j?9). 
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Information from a sampling of audit reports was transferred 
to the audit nianagomant information forms by a secretary 
to determine the length of tin^e necessary to complete 
transferring dati for all reports of the current year and 
last year. 

Last year's audit was coded for computerization so that 
a base year might be established. Additional clerical 
staff was assigned for this project for a short period of 
time. 

A data processing program was written to retrieve the following 
information: 

types of audit discrepancies by activity from 
the coded form 

the number of audit discrepancies by category 
This information will be used to: 

a. compare the types of audit discrepancies for 72-73, 
73-74, by activity and by category for each 
participating school. 

b. ascertain improper implementation in the areas of: 
professional position vacancies, paraprofessional 
position vacancies, non-receipt of materials, non- 
receipt of supplies, non-receipt of equipment, 
improper enrollment, and improper selection of 
students. 

c. ascertain the significance of each audit discrepancy 
classification on program success. 

d. ascertain the significance of combinations of audit 
discrepancies on program success. 
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CHAPTER VIII 
EVALUATION SUBCOMMITTEE 

The Evaluation Sub-Committee had a dual charge. The first was to 
take a leadership role in the development of instruments to assess the 
effectiveness of the "Field Test" and "Final Program Audit Handbook" and 
to evaluate the responses received. The second was to conduct an assessment 
of the work of the committee as a whole. 

The field test edition of the manual was completed in January 1974 and 
was distributed to a total of 200 staff members of the Chicago public and 
nonpublic schools, and to suburban school administrators. Each person who 
received the manual v/as requested to evaluate It and complete a questionnaire 
(see Appendix #3). Ninety-two persons responded. Eighty-five of the 
revlev/ers completed the questionnaire. Seven responded by letter. 

The questionnaire contained two parts. Part 1 consisted of ten 
sections corresponding to the sections within the handbook from the preface 
through the appendix. Each section had from tv/o to seven items for which 
responses were sought. A four-point scale, "Strongly Agree," "Agree," 
"Disagree," and "Strongly Disagree" was developed for recording responses 
to all of the items v/ith the exception of the final one which requested 
that respondents suggest revisions that might be incorporated. 

The questionnaire items included in Part 2 were designed to assess 
the reviewer's general reaction to the manual. A three-point scale was 
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used for three of the items and the final item solicited suggestions on how 

the handbook might be improved. All those who responded were Included on 

the mailing list for distribution of a copy of the completed document. 

The items on the questionnaire v/ere designed to assess several 

characteristics of the material contained in the manual 

appropriateness 

clarity 

relevancy 

practi cal i ty 

comprehensiveness 

simplicity 

The responses received from the 85 who had reviewed the document 
were generally positive in answering the 31 multiple choice Items. 
The range of "strongly agree" on any single item was from 16 (19^2) to 
38 (4550. The range of "agree" on any single Item was from 44 (52%) to 
59 (69%). Suggestions for modification were made In the majority of 
instances where "agree" rather than "strongly agree" was indicated by the 
reviewer. There were also many in: ances where "agree" was indicated 
and no suggestions were made for modification of those -iections. In a few 
instances, suggestions for modification were made even though "strongly 
agree" for an item had been indicated. 

Though the number of reviev/ers who "disagree" with the 31 items was 
small, at least one person responded "disagree" v/ith every item. The 
sections receiving the largest percentages of "disagree" responses per 
item were; 

Introduction 
Prescrvice of Auditors 
Rationale 
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The section for which the smallest percent of "disagree" responses 
was noted was, " Orcianlzation ." 

For the ten questions requesting a written comment on revision, there 
were a variety of responses. In five sections at least three persons 
commented in the following way: 
Introduction 

Wordy * 
Rationale 

Make more concise 3 
Procedures 

The procedures described will 

not insure objectivity 4 

Change title to Procedures 

for Audit 3 

Inservice 

More details needed if this 

is to serve as a guide 4 

Change title to Inservice of 
Auditors 7 

Audit Exceptions 

Audit exceptions should be 

discussed with the principal 

before leaving 7 

Part II of the field test questionnaire contained three items 
which requested the reviewers opinion of the total manual 
with relation to 

relevancy 

practic.ll ity 
readabil it^ 
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The responses of the 85 reviewers who completed the questionnaire 
were largaly distributed over three points of the scale. 
The replies to this section were somewhat more pointed due 
to the nature of the categories. Note the scale values for 
the two parts shown below: 

Scale Value Part II Pa^^t I 

4 Very positive Strongly Agree 

3 Positive Agree 

Relevant 
Practical 

Easy to Read (readable) 
2 Somewhat positive Disagree 

1 Negative Strongly Disagree 

Irrelevant 
Impractical 

Very Difficult to Read 
There was a "positive bunching" of responses in Part 1 in the 
"strongly agree" and "agree" categories of the scale, while a 
greater variation existed in the reviewer's responses to the items 
in Part II. As a result. Part II yields a slightly clearer 
picture of the feelings of the reviewers. From the variation 
in responses to Part II when compared to "positive" buncning 
of Part I, it can be inferred that the reviewers evidently did 
not consider "disagree" synonymous with "somewhat positive." 
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It is notable that in Item three, where the term "somewhat" was 
not a part of the scale, the "positive bunching" of responses 
occurred in a similar manner to that of Part 1. 
The very positive responses for Part II ranged from 21 (25%) 
to 31 (36?0 ; positive responses showed a range of 32 (38^,) 
to 46 (5455) and somewhat positive responses showed 27 (32%) 
and 17 {20%) respectively. The third item which contained the 
more negatively stated opinion showed a 4 (5%) negative response. 
The following summary shows the responses to the three choice 
items in Part II. 

Field Test Questionnaire Summary 
Part II 

1. How relevant is the manual to your local needs? 

Very Somewhat No 

Relevant Relevant Relevant Irrelevant Response 

Frequency 21 32 27 2 3 

Percent ZS% 38% 22% 2% 4% 

2. How practical are the procedures and guidelines offered in the 
manual ? 

Very Somewhat No 

Practical Practical Practical Impractical Response 

Frequency 25 39 17 1 3 

Percent 29% 46% 20% ^% 4% 

3. How readable is the manual? 

Very E<>.Gy Easy to Difficult Very Difficult No 

To Read Read to Read to Read Response 

Frequency 31 46 4 4 

Percent 36% 54% 5% 5% 
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The data gleaned from the "Field Test Questionnaire" was shared with 
the Writing Sub-Committee to be considered as the draft was refined and 

developed into final form. 

Two other instruments were developed by the. Evaluation Sub-Committee 
which dealt with the handbook. Both were designed to receive feedback from 
the field on the use of the handbook so that the effectiveness of this 
endeavor could be more accurately measured and to gather information to be 
incorporated into a rewritten document at a future date. 

A supply of a very simple form was attached to the letter of transmittal 
from the assistant superintendent to those receiving the handbook (see 
Exhibit #10). The recipients were asked to complete a copy of the form and 
send it to the Department of Government Funded Programs each tije the 
handbook was consulted. If a question was answered within the document, 
this was to be recorded. If the question could not be answered, it was to be 
recorded. Written responses will be supplied to any question not covered 
and steps will be taken to incorporate appropriate information in a revision 
at a later date. 

The second instrument was developed by the Evaluation Sub-Cornmlttee in 
cooperation with the General Committee. A letter from the assistant 
superintendent to committee members dated May 7, 1974 solicited questions 
to be incorporated into an instrument to be distributed in six months 
for purposes of evaluation and to gather data for a rewrite of the handbook 
if this appeared to be necessary. 
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BEST copy AVAILABLE 52 

Please send a copy of the PROGRAM AUDIT MANUAL 1974 to: 



(Name) 
(Address) 

{Q^V^ (State) (Zip Code) 



(Organization Affiliation) 



INSTRUCTIONS 

After you have read and become familiar with this manual on Program Audit 
procedures, your comments regarding the manual's usefulness, its content, 
and any suggestions that you feel would improve the manual would be 
appreciated. Thank you. 

COMMENTS: 



Also, would you please answer the following quefitions: Yes No 

1. Can you now determine the function of program audit. 

2. Can you now determine the role/responsibility of program 
auditors. 

3. Have you changed your perception of program audit 

4. How often do you think you will use this manual next year. 

5. How would you rate the quality of this manual. Superior Good Fa 

6. Which section do you think will be most useful to you Section # 

7. Which section do you think will be least useful to you. Section # 

8. Did you use this book to find an answer to any questions 
about the audit function. NO YES 

If YES: What was the question? 



9. 



Did you find an answer in the audit handbook NO YES 

If YES: What page? 
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In order to get some feedback from the coiranittee members concerning 
the work of the committee and an assessment of their personal involvement, 
the Evaluation Sub-Committee also prepared and distributed with the 
letter an instrument which was to be completed and returned (see Exhibit 
#11). 

Another task for the evaluation group was an assessment of the time 
and effort factors involved in the completion of the Handbook. Attendance 
records were maintained for all of the General Committee meetings. The 
attendance rate was 87 percent, which is a very favorable response. 
Soon after the formation of the sub-committees it became apparent that 
keeping accurate time and attendance records was impractical. The sub- 
committees met often, both formally and informally, for varying lengths 
of time. All members were not involved in all activities. However, based 
upon observation of the various activities and an assessment of the conduct 
of the regular departmantal and field duties, it was apparent that other 
responsibilities were not neglected. 

The time line which was established at the outset was met for every 
major step within the project. 

Tv/enty-five members of the General Committee complied with 
the request. The data received for inclusion in the questionnaire to be 
distributed in six months will be held by the chairman and eventually 
developed into an instrument. A tally of the responses to the instrument 
on involvement of the committee showed a very positive reaction from 
the participants. (See Exhibit #12.) 
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BOARD OF EDUCATION Exhibit #11 

CITY OF CHICAGO 
228 North LaSallc Strcct 

CHICAGO, lU-tNOIS C060I 
TtWHONt 641-4141 

Jamm F. Redmond 

MtM C. MOFFAT •■M«HAU »U^tmNTtMOtNT OF SCHOOLS 

9VKIIMMCHT rUNOCO PWOailAMS 
tUFNONl •4t«4900 



May 7, 1974 



Dear : ^ 

We are now in the process of preparing an evaluation questionnaire to 
accompany the Department of Government Funded Programs publication , A Guide 
to Program Aud it, when it is ready for distribution. Since you recently parti- 
cipated in the development of this publication, we are asking that you lend us 
further assistance as follows: 

1. Sending us any questions that you feel are appropriate 
for use in the questionnaire which we are developing 
for evaluation of the guide . 

2. Complete the enclosed General Committee Questionnaire. 

Both your suggestions for evaluation of the guide and the completed 
General Committee Questionnaire, should be returned no later than May 17, 1974, 
to this department . 

Your continuing cooperation in these matters will be most valuable to the 
department in its planning and implementation of future services. 

Sincerely , 



JGM: k James G . Moffat 



Sent to Committee Members 
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A GUIDE TO PROGRAM AUDIT 



Exhibit #11 
continued 



General Committee Questionnaire 



Was the membership of the general committee sufficiently representative 
to carry out the tasks assigned to the committee? 

Yes No Not Sure 

Was each general committee member's input considered by staff? 

Yes No Not Sure 

When first asked or appointed to serve on the committee , were you interested 
in serving on a committee to develop a guide to program audit? 

Yes No Not Sure 



Are you interested in serving on future general committees? 

Yes No Not Sure 

Was membership in the committee a worthwhile experience for you? 

Yes No Not Sure 

Did the committee function as well as you expected? 

Yes No Not Sure 

Do you believe most of the other members benefited from their membership in 
the committee? 

Yes No Not Sure 



Rate the Guide to Program Audit which the committee produced by drawing 
a circle around one of the ioilowing descriptive words which best expresses 
your opinion of the publication's value to tlie Chicago public schools. 

None Limited Some Much Great 

Make additional suggestions and comments relating to the committee and its 
work on the reverse side of this paifo . 

Please complete and return this 
questionnaire, no later than May 17, 
to the Department of Government 
Funded Programs, Room 1130, 
Mail Run m . 
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Tally of Hcsponsos Exhibit il2 

N = 25 A GUIDE TO PROGUAM AUDIT 

General Committee Questionnaire 

Was the membership of the general committee sufficiently represcntutive 
to carry out the tasks assigned to the eomiiiittee? 

Yes 25 No 0 Not Sure 0 

Was each general committee member's input considered by staff? 

Yes 19 No 2 Not Sure 4 



When first asked or appointed to serve on the committee, were you interested 
in serving on a committee to develop a guide to program audit? 

Yes 17 No 4 Not Sure 4 



Are you interested in serving on future general committees? 
Yes 17 No 5 Not Sure 3 



Was membership in the committee a worthwhile experience for you? 
Yes 22 No 3 Not Sure 0 



Did the committee function as well a.^ you expected? 

Yes 19 No 5_ Not Sure 1 

Do you believe most of the other members benefited from their membership in 
the committee? 

Yes 12 No 0 Not Sure 13 



Rate the Guide to Pr oTi^ am Audit which the committee produced by drawing 
a circle around one oi tlie following; descriptive words which best expresses 
your opinion of the publication's value to the Chicago public schools. 

6 8 11 

None Limited Some Much Great 

Make additional sufr^i-cstions and comments relating to the committee and its 
work on the reverse side of this page. 

NONE 

PlcaKc comt^K.te and roturn this ciuestioiinfiiro, no lator than May 17, 
to the l)i!partiiu'iit of Governniont Eundcd Programs, itoom 1130 » 
Mail Run ;fG5. 
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CHAPTER IX 
CONCLUSION 

The impact of a program audit project will be measured by executive 
administration, Boards of Education, and the general public based 
primarily upon the progress of the pupils who participate in the 
Instructional programs which were audited. The purpose of the hanabook, 
which was developed through the conduct of this practicum, is to further 
assist school administrators in conducting meaningful program audits. 
A premise embraced within the framework of this project has been that 
early identification of problem areas, and timely remediation can 
significantly improve the results of programs. 

The work already accomplished in the area of program audit in the 
Chicago public schools has already borne fruit. The final evaluation 
of the Title I activities for the 1972-73 school year indicated that 
participating pupils had a gain of seven months for eight months of 
participation.^^ In a comparable testing period, the 1971-72 gain was 
five months. The increase for 1972-73 was even more significant when 
compared to 1970-71 when the m was four months. 

When one assessed these gains, it must be remembered that participating 
pupils are selected from the lowest quart ile of the grades served. 
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The General Superintendent of Schools acknowledged the importance 
of the progrem audit activities in his letter of March 8» 1974, to the 
members of the Board of Education of the City of Chicago, transmitting 
the Title I Evaluation Report for 1971-72: "In reviewing the achievements 
of the ESEA Title I 1972-73 project, consideration should also be given 
to the effect of internal program audit upon the project. The Department 
of Government Funded Programs implemented an internal monitoring system 
at the beginning of the 1971 school year for all government-funded 
programs in the Chicago public schools. This audit system, by providing 
early feedback to personnel concerning guidelines adherence, has 
contributed to the gains achieved by the pupils participating in 
government-funded programs." 

Rarely a week goes by when the newspapers do not carry stories 
concerning school systems which are accused of audit exceptions in the 
implementation of federally funded programs, with an accompanying demand 
for repayment of funds. 

The handbook was received from the printers on June 3, and distributed 
to all of the Chicago public schools, to surrounding school district 
offices, and school officials throughout the country. (See Appendix #10). 

It is the hope of .ose who have worked to produce the Program Audit 
Handbook that it will assist school personnel throughout the nation to 
improve the delivery of services to the children enrolled in our schools. 
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FOOTNOTES 



^H.E.W. Audit Report, Title I of the Elementa ry and Secondary 
Education Act of 196 5, St ate of Illinois and the Chicaao Board of Education, 
Period: September 23, 1965, to Aunust 31, 1966 

^Draft of the Report to the Congress of the United States, The, 
Federal Pronram of Aid to Educationally Deprived Children in Illinois Can 
be Stfenqthensd - Office of Eaucation, Department of Healtn, Education, 
and Welfare, pg. 2 

^Ibid, pg. 13 

^Ibld, pg. 15 

^Ibid, pg. 35 

Worandum from John F. Hughes, Director, Division of Compensatory 
Education, USOE, to Chief State School Officers, April 14, 1967. 

^Memorandum from Commissioner Harold Howe II, USOE, to Chief State 
School Officers, March 18, 1968. 

^Memo> .. -ium from Commissioner Harold Howe II, USOE, to Chief State 
School Officers, July 2, 1968 

^ Organization Survey-Board of Education, City of C hicago, May 1967, 
Booz, Allen 2. Hamilton inc.. Management Consultants 

^^"Special Program in Reading and Language (SPIRAL) Activity," 
Compa ra tive Analysis of ESEA Title I Reading Activit ies 1971-72 Final 
Evaluetion Report , prepared by Educational Testing Service, Evanston, 
Illinois 

^^ ESEA Title I 1972-73 Final Evaluation Report - Volume I 
^ ^ESEA Title I 1971-72 Final Evaluation Renort - Volume I 
13eseA Title I 1970-71 Final Evaluation Report 
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Appendix ^ 1 



PROGRAM AUDIT: A MOVE TOWARD ACCOUNTABILITY 
A Proposal Submitted for Funding 



James F. Redmond 
General Superintendent of Schools 

Board of Education of the City of Chicago 

October 1973 
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A. Abstract 

This proposal seeks funding to improve the quality of educational 
programs for children participating in government funded programs through 
more effective and efficient internal program auditing procedures which 
have been developed and which will be published in a comprehensive handbook 
under the leaderhips of the assistant superintendent of schools for the 
Department of Government Funded Programs of the Board of Education of the 
City of Chicago. 

The trend toward accountability in education has brought about 

improvement in the quality of educational opportunities for children by 

placing renewed emphasis upon adherence to the goals, objectives, and 

procedures of programs designed for that purpose. Program audit is a 

functional necessity the major objectives of which are the following: 

To observe programs to determine if they are being implemented 
in accordance with the approved design 

To transmit information concerning audit exceptions to vhe 
appropriate line officer so that discrepancies can be 
corrected 

To develop articulation between local schools and management 
so that guidelines v/ill be clearly understood and programs 
implemented accordingly 

To obtain input from field personnel in order that program 
guidelines which are consistent with contractual limitations 
and helpful to successful program implementation may be 
developed. 

The proposed handbook of audit procedures will fill an unmet need 
which has long existed because funds are not available fcr its publication. 



62 



The handbook will be written and produced by personnel of the 
Department of Government Funded Programs and representatives of other 
units within the organization; however, funds will be required for a 
part-time artist, copy preparation, printing, and postage. 

B. Priority Area 

Government funded programs have been carefully designed to improve 
teaching-learning situations and to achieve stated goals through articulated 
means. The probability of program success will be enhanced if the number 
of pupils being served is in accordance with the design of the proposal. 
If the services of teachers are not diverted to other assignments at the 
expense of the program, if auxiliary staff are involved as specified in 
the proposal, if supplementary materials and equipment are available and 
properly used, if test results are used to plan more meaningful learning 
experiences, and if all other directives are foUov/ed. 

C. Objectives (See Pages 4 and 5) 

D. Dissemination 

Draft copies of the audit procedure handbook will be disseminated 
through local school advisory councils to communities, and their input 
and opinions will be sought so that changes and revisions may be made 
before the final publication and national distribution. 

In addition, information about the handbook will be disseminated 
through inservice meetings, announcements in the Superintendent of Schools 
Bulletin, letters to administrators within other school systems, and 
through notices of availability in government publications. 
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E. Evaluation (Se^ Page 6) 

F. Innovativeness 

The Department of Government Funded Programs, under the direction 
of the assistant superintendent, originated in fiscal 1972 the internal 
audit of programs funded by government agencies* 

Prior to that time, and to date, no instrument such as the proposed 
handbook had been developed to audit adherence of government funded 
programs to stipulated guidelines. 

6. Participation of Children and Teachers from Private Nonpublic Schools 

Administrators and teachers from private nonpublic schools will 
receive copies of the handbook and will be invited to attend inservice 
meetings outlining its use. 
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Program Audit: . A Move Toward Accountability 



BUDGET 



Clerical Support 

(Part-time typist for project) 

Non-professional 
(Part-time artist) 

Materials: 

Paper and printing of 6,500 
program audit handbooks 

Dissemination of handbooks 



$2,000 
1,000 



6,000 
100 



TOTAL 



$9,100 



Members of the Department of Government Funded Programs will reserach 
and prepare the materials for publication. J 



ERIC 
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AMM O, MOFFAT 
(••itTAHT •UWHIMTtNOKMT 

OVCAMMtMT FUNDtO ^KOOMMft 

aUTHOHK «41*4SOO 



CITY OF CHICAGO 
228 North LaSaulc Street 

CMICAOO« 1UUN016 6060t 

James F. Redmond 

•INCIIAW •UFKRlNTeNOENT OP SCHOOLS 



BEST COPY AVAILABLE 



September 27, 1974 



Dear : 



The Department of Government Funded Programs of the Board of 
Education of the City of Chicago has developed a project for increas- 
ing the effectiveness of inservlce programs given to local school units 
in the process, methods, and techniques of proposal writing. We plan 
to create audiovisual and printed materials to be used in proposal 
development workshops for principals, staff, and community representatives. 

There is an urgent need for such a project, hot only in Chicago, 
but also in school systems throughout the country, with whom, of course, 
we shall be most happy to share these materials. 

Approximately $10,000 is needed to create and disseminate the 
various items necessary to the success of this activity. May we, there- 
fore, solicit your support in underwriting all or as much of this project 
as you may find it possible to do at this time. 

I have asked Robert L. Johnson, a member of the staff of the 
Department of Government Funded Programs, to contact you and provide any 
additional information you may desire. 



Sincerely, 



JGM;1 
enclosure 



James G. Moffat 



APPENDIX n 

DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 



Program Audit Checklist 
General Infonndtion 



School 



Auditor(s) 



Activities 



Date 



1. 



STAFFING 



a. Does staffing at the school coincide with our staffing information? 
List any discrepancies. 



b. List by activity any unfilled positions. 



c. Are teachers charged to the correct position numbers? Verify 
four teaching position numbers by asking the teachers in what 
activity they are working and checking the division openings 
for these. 



2. MATERIALS, SUPPLIES, EQUIPMENT 

a. Approximately what percent of the materials and supplies were not 
delivered as of the audit date? 



b. Did the materials for structured reading programs arrive on time? 
If not, indicate the activities for which they were not delivered. 



Activity 



Professional 



Position No. 



Paraprofessional 
Activity 



Page 2 
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c. List materials and numbers of purchase order over the amount of 
$100 that have not been delivered as of the audit date. Give the 
date of the requisition. (Comprehensive audit only.) 

d List equipment and the purchase order numbers that have not been 
delivered as of the audit date. Give the date of the requisition. 



e. Please remind the principal that invoices must be returned immediately. 

f. Is there an updated inventory of equipment? Spot-check at least 
four items. 



g. For structured programs, is the equipment necessary for the operation 
of the activity functioning and located in its appropriate setting? 



3. COMMUNITY INVOLVEMENT 

a. Is there a separate advisory council for government-funded programs? 
If not, how often are government- funded programs discussed at 
regular council meetings? 

b. When and how frequently does the advisory council meet? 

c. How many members are on the council? 

d. What percent are parents? 

4. INSERVICE 

a. What inservice do professional and paraprofessional personnel in 
government-funded programs receive? 



b. Briefly describe your inservice programs for government-funded 
personnel . 
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c. Who conducts the inservice? 



5. DISSEMINATION 

How Is information concerning government-funded programs disseminated? 
(Have the principal fill- out the form prepared by Editorial and 
Communication Services.) 



6. CLASSROOM OSSERVATION 

The information pertinent to the following questions is to be filled 
In on the form provided. Directions concerning use of this form are 
printed on its reverse side. 

a. Check test scores of one or two eligible pupils in each class to 
determine whether they meet eligibility guidelines. 

b. Is staff used in conformity with stipulated guidelines? 

(If not, note discrepancies.) Check schedules of teachers and 
paraprofessionals. 

c. Is equipment for the program properly labeled? Check for items. 



d. Is equipment available for classroom use? 

e. Check for conformity and availability of instructional 
materials with the correct activity. Note this on the form 
provi ded . 

f. According to the teacher's class list and daily time schedules, 
how many children are being served daily in each class? Note 
observed attendance. 



g. Are there time conflicts which reduce the time the child 
participates in the core programs. List them. 



o 

ERIC 
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h. Are books properly labeled v/ith the information concerning the 
funding source and in evidence in the classroom? 

1. Are the Title I participants involved in other Title I activities? 
Indicate this in the column labeled Ob served Supportive Services. 
List the numbers of pupils so involved. 

j. Are Title II mateirals properly labeled and is there an inventory 
of these? (These are to be in the school library with the 
teacher librarian.) 

7. COMMENTS 

a. Principal's comments. 



b. Auditor's comments. Do the programs appear to be operating within 
guidelines? 



BEST COPY AVAlLABli 
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AMIS O. MOFFAT 
•IBTANT •UrtRINTENOCHT 

OVMHMCNT rUNOCO FMGftAMS 



CITY OF CHICAGO 
228 North LaSalle Street 
chicago. illinois 60601 

TCLCrHONK 641-4141 

Jamgs F. Redmond 

OKNCIUW SUFEfllNTSNDCNT OF SCHOOLS 



January 18, 1974 



Dear : 



During the past three years, the Department of Government Funded 
Programs of the Chicago public schools has developed program audit 
techniques to ensure that government funds are expended within contract 
guidelines, to decrease the number of exceptions, and to improve the 
educational programs available to participating children. 

The Department of Government Funded Programs is preparing a program 
audit procedures manual to promote the achievement of these objectives. 
Since this entire project is possibly the first of its kind attemoted 
by any school system, we hope that by sharing our experiences with other 
school districts and groups, we may helo them to develop their own 
internal audit procedures. 

To ensure that this document will reflect the participation of all 
staff of the Chic-go oublic schools and to present the best possible 
manual, I would aooreciate your reviewing the enclosed draft copy and 
returning the evaluation to my office by January 31, 1974. 

Your reaction will help us fur'-.her develop our plans to disseminate 
guidelines and procedures for conducting an internal audit of government 
funded programs. Thank you for your cooperation in this most imporrtant 
task. 



Enclosure 
Sent to: 

Chicago public school principals 
Non-public schools 
Community representatives 



Sincerely, 



JGMrkw 



James G. Moffat 



ERIC 



Mailing List 

Principal 


Area 


74 

Mail Run 


Dr. Marie V. O'Brien 


A 


64 


Frank Lucentc, Jr. 


A 


62 


John W. Hahn 


B 


. 59 


Roland J. Long i 


B 


59 


Elizabeth T. Mollahan 


A 


66 


Richard C. Portee 


C 


67 


Mrs. Mary A. Saxton 


A 


61 


Dr. Nicholas P. Kushta 


A 


64 


Edmund J. Kubik 


B 


62 


Dr» Joseph H. DiLeonarde 


C 


* 51 


Mr. Edward C. Bennett 


C 


51 


Dr. Raphael P. Sullivan 


C 


67 


nrs • nennese c » fxODCrbS 


It 

D 




Mrs. DeDora uoraon 
o 


f 

u 


O/ 


Dr. Ernest C. Billups 


A 


63 


Mr, Michael Lag 


B 


52 


John F. Smith 


A 


64 


Virginia Godenrath 


B 


57 


Loretta M. Francis 


C 


53 


Mr, Blaine DeMye 


C 


67 


Dr. Keith C. Wecse 


B 


67 


Mrs. Emilie U. Lepthicn 


C 


51 


Alvin C. Boyd 


A 


62 


Mrs, Chcsna C, Wcisberg 


A 


63 


Sheldon E. Barron 


C 


55 



1 

chool 


Thomas J. Kernan 




75 

Mail Run 


valon Park 


A 


66 


r 


Donald E. Sparks 


A . 


61 


aum Br. of Twain 


Mary P. Mack in 


B 


59 


eethoven 


Dr. Molvin M. Lubershane 


A 


62 


ennett 


Robert Long 


A 


60 


laine 


Karl Siewers 


C 


54 


rainard 


Joseph D. Murphy 


B 


52 


right 


Lester A. Bensema 


A 


64 


ucJcinghara Br. of Warren 


Loretta I. Mulcahy 


A 


64 


urnham 


Regina T. Koehl 


A 


64 


^ford 


Michael Fabing 


C 


• 

53 


arapos Bilingual Center 


Natalie A. Picchiotti 


C 


51 


arter 


Robert W. Pospishil 


A 


61 


i 

Rappell 


Douglas Moderow 


C 


54 


lay 


Jean G. Dillion 


A 


64 


»lumbus 


Michael Striegl 


C 


51 


opernicus 


Robeit E. Hagan 


B 


59 


illcn 


Lewis J. Webster 


A 


63 


l^lano 


Bernard M. Tanenbaum 


C 


67 


5wey 


Mrs. Penelope Robinson 


B 


62 


)niat 


Michael Minkin 


B 


58 


>uglas 


Walter R. Fasan 


B 


58 


jffy 


Robert J. Dreuth 


A 


63 


forak 


Benjamin H. Terry 


B 


57 


)ingcr 


Dr. Frances Pietcli 


C 


56 


Instcin 


Sander M. Postoi 


B 


58 



ERIC 
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Principal CQ?^ MM^^^ea 


Mail Run 


Bruce E. Troutman 


A 


60 


Vincent A. Castrogiovanni 


B 


58 


Mr. Lewis J. Webster 


A 




Loui-s Asher 


B 


59 


* 

Mary A. Finan 


B 


57 


Mrs. Peggy W. Jackson 


C 


53 


Robert A. Kellberg 


C 


SO 


Mary Ann Peterson 


A 


60 


Edmond E. Walsh 


B 


58 


Marion L. Castle 


B 


60 


Daniel G. Breen 


B^ 


58 


Patrick D. Noonan 


B 


62 


Edwin L. Ford 


B 


62 


John P. McGovern 


B 


57 


Lillian F. Bowden 


B 


62 


James A. Clear 


C 


53 


Dr. Ruth 0. Secord 


B 


59 


Mrs. Elizabeth Bray ton 


C 


55 


Herschel J. Rader 


B 


57 


Samuel R. Altshuler 


A 


61 


Mrs. Margaret D. Julstrom 


A 


60 


Dr. Ira H. Mouell 


C 


51 


William A. Pollak 


C 


54 


Marie L. Stciner 


C 


50 


Maude H. Carson 


C 


50 



- 4 - 
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77 

Mail Run 




A 


64 


KaymOIlQ ucnxiv 


B 


57 




A 


62 




A 


60 


• 

M<rc Ml r 1 ATH A Pntni 


B 


52 


uorocny h» Dx^evens 


B 


58 


00 vX/ «• viurniau 

m 


c 


54 


A11C6 M» Maresu 

• 


r 


54 


HAClCxXIXC u» oncxxuau 


A 


■ 66 


jonn «i • vixazxer 


B 


59 




B 


58 


Gus Lncatnam 


A 


64 


ouanicy oiasirc 


c 


51 




c 


50 


Mrs»^Katnryn a» uomxa 


B 


60 


Nrs» Anna iv« cgau 


B 


57 


Dr» cQwaro J • UDer 


IP 


57 




c 


5U 


ijGon a xQ i^i • 1 u ci 


A 


63 


Kaymonu r* nwxxniaiin 


A 


66 


Theodore £• Hagcnsee 




52 


Ned Lee McCray 


A 


66 


James D» Money 




59 


Miss Mary A. Ransford 


r 

V 




Mr. Major Armstcad, Jr. 


B 


57 


Mrs. Sonja K. Bccvar 


B 


C7 





Princii>al «t<^ ^ 


Area 


78 

Mail Run 


|hields 


Donald F. Kimball 


B 


57 


jkinncr 


Aithur M. Shapiro 


B 


52 


(cCutcheon 


Mtss Mary E. Foran 


C 


55 


itevcnson 


Dr. -Kathleen C. Cartan 


B 


60 

• 


Itowe 


• 

Mildred E. Chuchut 


C 


50 


ivift 


Seymour Miller 


C 


55 




Kenneth J. Dei' I 


A 


62 


horp, Ole. A. 


Reynolds A. Hungerford 


C 


55 


Wain 


Mary P. Mackin 


B 


59 


acker 


Howard Felder 


A 


60 


ashington 


• 

Lois K. Schmidt 


A 


64 


est Pullman 


Elizabeth Van de Roovaart (Dr) 


A 


63 


ocke 


Mr. Arthur A. Fumarolo 


C 


53 


Godson North 


Leroy R. Hansen 


B 


58 


ate» UGC 


Herman R. Margolis 


C 
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Nonpublic Schools 



Sr. Susan Marie Curt in 
St, Ambrose 
1014 East 47th Street 
Chicago, Illinois 60653 



Sr. Bertilla Barrett 
Our Lady of the Angels 
3814 West Iowa 
Chicago, Illinois 60651 



Sr. Mariea McKee 
St. Bede the Venerable 
4440 West 83rd Street 
Chicago, Illinois 60552 



Sr. Marion Murphy 
Blessed Sacran^ent 
2130 South Central Park 
Chicago, Illinois 60623 



Miss Grace Creighton 
St. Bernard 
6547 South Stev/art 
Chicago, Illinois 50621 

o 

Mr. Earl M. Singleton 
St. Frances X. Cabrini 
751 South Sacramento 
Chicago, Illinois 60612 



Rev. H. Robert Clark 
Archdiocese of Chicago 
721 North LaSalle Street 
Chicago, Illinois 60610 



Mr. Edward F. Krueger 
Office of Christian Education 
77 West Washington Street 
Chicago, Illinois 60602 * 



Rabbi Isaac Mayefsky 
Associated Talmud Torahs 
2828 Pratt Boulevard 
Chicago, Illinois 50545 



Mrs. Anne Tyskling 
Harvard-St. George School 
4731 South Ellis Avenue 
Chicago, Illinois 60515 



Mr. Edward Pollack 
Holy Cross 
6537 South Maryland 
Chicago, Illinois 60637 



Sr. Mary Jane 
St. Michael 

1620 North Hudson Avenue 
Chicago, Illinois 60514 
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COMMUNITY MDIBERS MAILING LIST FOR PROGRAM AUDIT 

MANUAL 



Mrs. Will a Mae Gardner 
4345 So. Langley 
Chicago, mi no is 60653 
(Woodson South) 



- Title I Advisory Council Member 



Mrs. Billie J. Paige 
Citizens Schools Committee 
9035 South Blacks tone 
Chicago, Illinois 60619 



- ESAA Community Council President 



Mrs Laura James 
656 North Spaulding 
Chicago, Illinois 60624 
(Beidler School 



- Head Start Parent Advisory Council 



Ms. Ophelia Gonzalez Ross 
3520 No. 3roadv/ay 
Chicago, Illinois 60657 



- EPDA Council Representative 



Mr. Lalo Carrizales 
9727 So. Houston 
Chicago, Illinois 60617 



- Bilingual Council Representative 
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JAMCS MOFFAT 
ASSISTANT •wrtSlNTSMOrNT 

•OVCMHMeNT rUNOCO MOOSAMS 

XSLt^HONK 04t*4900 



BOARD OF EDUCATION 

CITY OF CHICAGO 
228 North LaSalue Street 
chicago. illinois 60c0i 

TKLIPMONK 64t.414t 

James P. Redmond 

•tNnUk •urCKINTCNOINT or SCHOOL* 



January 18, 1974 



Dear : 

The Departmant of Government Funded Programs, Board of Education, 
City of Chicago, is preparing a program audit manual based on our ex- 
periences in monitoring government-funded programs. The purpose of 
this manual is to improve program audit procedures within the Chicago 
public schools and to share with other school districts and agencies 
its successful monitoring procedures developed by the department. 

This manual will be available for a field test within the next 
several weeks. 

Since we will share our experiences with other school districts 
when the manual is completed, we are including districts other than 
our own in a field test. 

I would oppreciate your distributing copies of this field test 
manual to 4 of your administrators, ask then to read and resnond to a 
brief questionnaire which is enclosed. This field test will assist us 
in determining whether this document might be of value in a school 
district such as yours and the additional information it :hould con- 
tain if an internal program audit were to be initiated in a school 
district such as yours. 

We appreciate any assistance you may be able to give us in this 
endeavor. 

Sincerely, 



JGM:kw James G. Moffat 

Enclosure 

Sent to: 

Superintendents of - Gary, Indiana 

Chicago Heights, Illinois 
Niles, Illinois 
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Program Audit Manual 
Field Test Questionnaire 



NAME 

POSITION DISTRICT OR AREA 

BUSINESS ADDRESS , TELEPHONE 

SCHOOL SYSTEM 



Please mail the completed questionnaire by January 31, 1974 to — 

James G. Moffat, Assistant Superintendent 
Department of Government Funded Programs 
Board of Education, City of Chicaco 
228 North LaSalle Street, Room 1130 
Chicago, Illinois 60501 (Hail Run # 65) 



Part I 

This part of the field test questionnaire requests your specific suggestions 
for improvement in the content of the manual. 

The sections of the manual for v;hich your comments are requested are as 
follows: 

Preface 

Introduction 

Section 1 - Rationale 

Section 2 - Organization 

Section 3 - Procedures 

Section 4 - Preservice of Auditors 

Section 5 - Audit Excections 

Section 5 - Benefits of Audit 

Section 7 - Use of Program Audit for Total Operation 
Appendix 

Please circle the response v/hich best characterizes your reaction to the 
material contained in euch ^.ecticn. Space hus been provided for specific 
suggestions regarding i:;Odi ficution. 

It will be helpful if you will include the page number and the number of 
the paragraph tor which the revision is suggested. 

If additional soaco is needed, please use the back of the sheet, or, if 
necessary, add adJitionu] sheets. 
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Preface 



1. The purpose is clearly stated. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Agree 



2. Revise this section as follov/s: 



Introduction 

1. The background material is relevant and provides a reasonable basis for 
the manual. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

2. The information is complete and appropriate for this section. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

3. Revise this section as follows. 
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Section 1 - Rationale 



The title is appropriate for this section. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

The rationale is clearly and comprehensively stated. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

All other material in Section 1 supports, clarifies, or amplifies the 
rationale as expressed in the first paragraph. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

Revise this section as follows: 
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Section 2 - Organization 

The title is appropriate for this section. 

n 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

The organization of the Division of Program Audit is adequately 
described. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

Related departirental and divisional organization plans lire included 
where relevant; they are adequately described; and their relationship 
to the program audit organization is clearly indicated. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 



Revise this section as follows: 
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Section 3 - Procedures 



The title is appropriate for this section. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 



The procedures are clearly stated, and the order in which each step 
should be implen^anted is easily understood. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 



The procedures are adequately detailed so that an individual could, 
with this section and the audit instruments, conduct an audit. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 



Revise this section as follows: 
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Section 4 - Preservice of Auditors 



1. The ticle of this section is appropriate. 

4 3 



Strongly Agree 



AgriBQ 



2 1 

Disgaree Strongly Disagree 



2. All the material is appropriate for this section. 



Strongly Agree 



3 

Agree 



1 



Disagree Strongly Disagree 



3. The order in which the material is presented is correct. 



Strongly Agree 



3 

Agree 



2 1 

Disagree Strongly Disagree 



4. 



Any person wishing to use this section as a guide to planning and 
conducting a preservice session could easily do so by following th< 
information given in this section. 



Strongly Agree 



3 

Agree 



2 1 
Disagree Strongly Disagree 



5. Revise this section as follows: 
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Section 5 - Audit Exceptions 

1. The title is appropriate for this section. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

2. All material presented is appropriate for this section. 

4 b 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

3. The term "audit exception" is adequately defined. 

4 3 2 1 

Strong! ' Agree Agree Disagree Strongly Disagree 

4. The kinds of items which must be checked to gather adequate information 
to determine an audit exception are included in this section. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

5. Explanation of the responsibility for reporting audit exceptions and 
the reporting procedures are given. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

6. Adequate justification for the reporting procedures is included. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

7. Revise this section as follo'./s: 
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1. The title is appropriate for this section. 



Strongly Agree 



3 

Agree 



2 1 

Disagree Strongly Disagree 



2. The material in this section is appropriate. 



Strongly Agree 



3 

Agree 



2 1 

Disagree Strongly Disagree 



3. The relationship of the audit procedure to the improvement of a given 
program is clearly indicated. 



Strongly Agree 



3 

Agree 



2 1 

Disagree Strongly Disagree 



4. Revise this section as follcv/s: 
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Secclon 7 - Use of Program Audit for Total Operation 

1. The title i. appropriate for this section. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

2. The benefits of program audit are clearly and comprehensively stated. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

3. All other material in this section supports, clarifies, or amplifies the 
stated benefits. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

4. Revise this section as follows: 
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Appendix 

1. The reasons for including the info* nation in the Appendix are clear. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

2. The introduction to the Appendix is clear. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

3. The items in the audit checklists are clearly stated. 

4 3 2 1 

Strongly Agree Agree Disagree Strongly Disagree 

4. Revise this section as follows: 
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PART 11 



The following questions concern your general reaction to this manual. For 
each of the questions, please circle the response which best characterizes 
your reactions. 



1. How relevant Is the manual to your local needs? 



Very Relevant 



Relevant 



Somewhat 
Relevant 



1 

Irrelevant 



2. How practical ore the procedures and guidelines offered in the manual? 



4 

Very 
Practical 



Practical 



Somewhat 
Practical 



1 

Impractical 



3. How readable is the manual? 



4 

Very Easy 
to Read 



3 

Easy 
to Read 



Difficult 
to Read 



1 

Very Difficult 
to Read 



4. If you have any suggestions about additional material which you feel 

should be in this manual or any material which should be deleted, 

please include these in the space provided below or on the back of 
this sheet. 



Thank you for your valuable assistance. A copy of the manual will be mailed 
to you upon its couplet ion. 
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PREFACE 

The purpose of this manual is to explain the technique for audit 
procedures used in the Chicago public schools and to share with other 
school systems and other groups the experience of the Chicago public 
schools in monitoring educational programs funded by various agencies. 

This structured program audit is an onsite examination by trained 
personnel to ensure project compliance with established goals, objectives, 
and procedures. The audit is not an analytical evaluation. It is 
Intended to determine if the contract terms are being met and to 
anticipate problems which may arise. 

While the procedures have been designed for use by a large urban 
school system, they lend themselves, with very .little modification, 
to smaller systems and to all educational programs. 
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INTRODUCTION 



Accountabnity Is an adjunct to all professional endeavors. Phy- 
sicians are accountable to their patients, to the hospital, and to the 
American Medical Association; attorneys are accountable to their clients, 
to the courts, and to the Bar Association; and educators are ultimately 
accountable to their students, to parents, fnd to the community* 

When all teachers fully understand the goals and objectives of the 
subjects they teach; when they are accountable to the community and the 
principal for the attainment of those goals and objectives; when the 
principal Is accountable to his communii;y, his faculty, and his superior 
for the quality of teaching which is representative of his school; when 
the district superintendent Is accountable to the community, to the 
principals, and to the teachers of his district for the quality of his 
leadership; and when those charged with the responsibility for curricula 
create programs which reflect the needs of the children, there will be 
overall Improvement in education. Constant monitoring of all elements 
Increases that probability. 

The most efficient way to move toward educational accountability is 
through measurable goals, objectives, and evaluations which are consis- 
tent with established guidelines and which are written into educational 
programs. When these goals, objectives, and evaluation techniques have 
been stated, accountability may be achieved through monitoring to ensure 
their proper implementation. Educational programs, especially those 
funded by agencies outside a school system, must be audited so that 
accountability of the local educational agency to the funding source may 
be satisfied. 

o 
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In 1971. the Department of Government Funded Programs of the Chicago 
public schools created the Division of Program Audit, charged with the 
responsibility for designing a vehicle through which Internal, objective 
monitoring could be accomplished. The vehicle was field tested and 
changed to agree with suggestions received, and. after revisions had been 
Incorporated, ludlt procedures became an Integral part of program admini- 
stration. Chicago thus became possibly the first school system In the 
country to develop systematic procedures which indicate the degree to 
which individual programs are being Implemented according to guidelines 
and which provide administrators with data for program improvement and 
accountability. 

It is the hope of the Department of Government Funded Programs of 
the Chicago public schools that this manual will be a practical and use- 
ful addition to the canon of accountability and that it will lead, through 
improved program implementation, to Improved educational opportunities 
for all children. 
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RATIONALE 

Monitoring of educational programs may be performed by personnel out- 
side the local educational agency. There are commercial enterprises with 
personnel trained to provide this service, but this is costly to the local 
educational agency and, in some cases feedback necessary to admin istra- 
tors Is not as readily and quickly available as it must be. Funding 
agencies have always monitored programs to determine their adherence to 
guidelines, usually, however, after the programs have been in force for 
some time. Funding can be and is endangered if discrepancies are not 
corrected by the local educational agency prior to this outside evalua- 
tion. The advisability of an internal audit is obvious. 

An internal audit Is an objective observation, by professional 
personnel, of the implementation of a program designed to achieve stated 
educational goals and objectives. Assessment of the quality of instruc- 
tion o'bserved is not within the purview of the auditor; however, since 
It Is incumbent upon the local educational agency to provide funding 
sources, such as the federal government, state and municipal governments, 
and private foundations with data indicating the use to which funds are 
being put, ongoing monitoring assures management of program activities 
which are commensurate with the philosophy and guidelines of the funding 
source. Then, If a program is not successful even though it follows the 
stipulated design, it becomes the function of evaluation to analyze the 
design and to determine what factors contributed to the program's failure. 
Within some school systems, accountability for program management may 
rest in a department created for the purpose; in others it may be a shared 
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responsibility. The organizationwVnanagement system chosen negates 
neither the use nor the value of internal program audit. 

In the Chicago public schools, programs are monitored to ensure that 
the number of pupils being served is in accordance with the program 
description, if aides are involved as specified, if teachers are used 
appropriately, if supplementary materials and equipment are available 
and properly used, if test results are being used to plan meaningful 
learning experiences, and if all pertinent directives are being followed. 
These components form the basis of the contract entered into by the schools 
ftnd the funding source, and accountability for their implementation is 
Inherent In the contract. 

Although each program contains specific elements aimed toward 
Improvement In educational opportunity for the children served, legisla- 
tion which governs proposals submitted for funding Is fairly consistent 
under all titles. Auditors are familiar with the following components 
which are Included In all proposals: 

1. The comprehensive needs assessment from which priority 
needs are taken and which, then, becomes the basis for 
the proposal. This needs assessment is usually conducted 
under the auspices of a Research and Evaluation com- 
ponent of the local educational agency. Hard and 

soft data concerning students and conununity are examined 
to determine whether current programs are as successful 
as they might be and what might be added to Insure 
their success. 

2. Performance Objectives - These are the goals of the 
program which flow directly from the priority needs 
established by the school. They are stated in be- 
havioral terms and must be subject to measurement. 
The Research and Evaluation component of the local 
educational agency is usually instrumental in develop- 
ing these. 
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3. Procedures - These are actually the blueprints of the 
program, the design is specifically stated. The 
duties of the staff are clearly delineated as are 
the number of pupils to be served, the length of time 
they are V e served, and the kinds of materials 
that will be used. 

4. Evaluation - This is the measurement of whether the 
procedures have attained the stated objectives. A 
comprehensive evaluation is based on pre- and post- 
standardized tests, questionnaires, attitude inven- 
tories, and classroom observation. It should be 
ongoing, and in cases where independent program audit 
Is required by a funding agency, it consists of an 
audit of the evaluation to detennine whether the 
program design is consistently achieving the stated 
objectives. 

5. Dissemination - Information concerning specially funded 
programs should be widely distributed as should the 
results of the evaluation. Dissemination can be ac- 
complished through flyers, pamphlets, filmstrips, 
films, word of mouth, and community activities such 

as open house. 

6. Coiwnunity Involvement is usually mandated by funding 
agencies from the inception of the proposal. Parents, 
teachers, community leaders, and even students should 
be Involved in planning educational programs. 

7. Staff Development is an integral part of every pro- 
posal . Since most specially funded programs are of a 
temporary nature, the training of staff in sound but 
Innovative educational techniques is a necessity so 
that good programs may continue even when special 
funding ceases. 

8. Supplementary Nature of Programs - Special funding Is 
invariably granted to supplement the efforts of 
local school districts. Every child in a school 
district is entitled to its services. Therefore, 
when funds are granted for specific purposes by a 
funding agency these are, in fact, additional, and 
the local educational agency is expected to continue 
all services previously provided. 
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Audit procedures established by the Department of Government Funded 
Programs follow a "line-staff" relationship, explained in the following 
quotation taken from Facts and Figures, published by the Board of Education 
of the City of Chicago, 1972-73: 

The administration of the school system is 
by direct "LINE" from principal, through District 
superintendent, through Area Associate Superinten- 
dent, to Deputy Superintendent and Superintendent. 

"STAFF" people who 
assist the administrator. The principal in the 
school has staff who assist him with administration, 
as well as teachers. Each district office has a 
human relations coordinator; some also have staff 
assistants for Elementary and Secondary Education 
Act programs (ESEA), and Model Cities programs. 
Area Associate Superintendents have an adminis- 
trative stf-fr of seven or more members including 
the Area Chief Engineer and Directors of Adminis- 
tratlon. Area Programs. Curriculum. Human and 
Community Relations, Pupil Personnel Services, and 
Special Education and ESEA Programs. Some di- 
rectors are provided with « staff of assistants 
or consultants. Assistant and Associate 
Superintendents head departments at the central 
office, eight serving on the planning staff under 
the General Superintendent, and eight serving on 
the operational staff under the general administra- 
tive supervision of the Deputy Superintendent. 
Assistants to the General and Deputy Superinten- 
dents serve respectively as their immediate aides. 

At every level, "STAFF" people advise and 
assist with planning, but "LINE" administrators 
have direct responsibility for administrative 
decisions at their operational level. The only 
aspect of school administration that is outside 
the "LINE" of authority outlined above is the area 
of plant operations and maintenance. 

The chart on the following page shows the organization of the Chicago 
public schools. 



OrgofiwaHon Chorf— Chicago PuhUc Schoo/s 
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Ip accordance with the line-staff organization, accountability for 

program implementation rests with the principal or unit head. His 

accountability to his district superintendent and to the program itself 

Is achieved through the following: 

Being familiar with the requirements written into the pro- 
posal and recognizing them as binding upon the funding 
agency and those charged with program implementation. 

Planning for the various components of the program before the 
actual date of Implementation. 

Keeping documents to ensure the success of the program. This 
Includes records of position openings* requisition records, 
and minutes of advisory council meetings. 

Observing the components of the program on a scheduled basis 
to note exceptions. 

Communicating to appropriate personnel those exceptions that 
do not permit the program to be properly implemented. 

Similarly, the Department of Government Funded Programs is accoun- 
table to the funding agencies, to the Board of Education of the City of 
Chicago, and to the schools having funded programs, for which the 
department provides the following services: 

Serves as the contact between all funding agencies and the 
Chicago public schools 

Identifies sources of funding for all proposals developed by 
school and administrative units | 

Provides functional leadership and technical assistance to 
school units In the development of proposals 

Provides guidelines to unltr implementing proposals that 
have been approved by funding agencies 
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Conducts ongoing program audits to ensure that programs 
approved for funding are Implemented In accordance with the 
proposal as developed, with guidelines of the funding 
agency* and with policy established by the Board of 
Education which Includes 

developing Inservlce workshops concerning program audit 
techniques for both central office and field staff 

conducting frequent visits to schools Implementing funded 
programs to ensure contract compliance and to make certain 
that guidelines are followed 

providing appropriate line and staff with the results of 
program audit visits 

performing appropriate follow-up visits to make certain 
that program audit discrepancies have been corrected 

preparing periodic reports for funding agencies and local 
staff, and describing the manner in which programs have 
been implemented, as determined by program audit visits. 

The department also — 

Provides financial management services to ensure that funds 
are appropriately and efficiently expended in compliance with 
the proposal as approved, as well as with legislative and 
funding agency directives 

Provides administrative services to ensure timely and appro- 
priate implementation of program by field units 

Provides appropriate evaluation services to assess funded 
programs and to meet funding agency requirements 

Works with appropriate staff in the dissemination of research 
data relevant to funded programs 

Provides for dissemination of information concerning government- 
funded programs. 

The following chart depicts the organization of the Department of 
Government Funded Programs. 



In fulfilling its responsibility to monitor programs, the Department 
of Government Funded Programs performs two discrete functions. Accoun- 
tability for ascertaining the degree to which guidelines are being met 
in operative programs is the mandate of the Division of Program Audit; 
accountability for data concerning the effectiveness of operative programs 
Is the mandate of the Division of Research and Evaluation. Each division 
performs its particular function, and both are accountable to the 
assistant superintendent who is the head of the department. 

Each division has general and specific responsibilities. The 
Division of Program Audit is primarily concerned with ensuring adherence 
to program design by individual schools; the Division of Research and 
Evaluation is concerned with program effectiveness and with the iden- 
tification and examination of all factors not .included in the program 
design as well as those within the design which contribute to program 
outcomes. 

'Specifically, the Division of Program Audit is accountable for the 
following: 

Examining the program design and guidelines and verifying 
compliance. 

Identifying operational discrepancies between procedures as 
described in guidelines and actual operational procedures for 
activities in the local schools or participating groups and 
reporting these discrepancies to appropriate line and staff 
for remediation. 

Making verbal or written reports to management for treatment 
of individual operational problems and discrepancies noted 
during the course of audit visits. 

Acting on recommendations by the Division of Rei^earch and 
Evaluation which relate to operational problems requiring 
immediate attention. 
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The specific responsibilities of the Division of Research and 
Evaluation are as follows: 

Comparing actual program operation (determined by collected 
data) with the program design and guidelines prepared by 
program managers. 

Determing the degree of adherence of the program to the 
requirements stipulated in the program design; identifying 
assets, discrepancies, and any other significant data 
pertaining to the program. This includes seeking in-depth 
Information to ascertain the nature and causes of the data 
characteristics in order to detennine the influence of these 
characteristics on program effectiveness. Making judgments 
on the basis of an analysis of gathered data. 

Making periodic reports to local, state, and federal agencies 
containing implications and' recommendations based on data 
analysis for immediate and long-range decisions concerning 
specially funded programs. 

Where appropriate. Including information provided by the 
Division of Program Audit in evaluation reports and examining 
audit information to ascertain additional areas requiring 
detailed evaluation. 
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Procedures 



The audit procedures established for the Chicago public schools will 
be described in this section; however, although they are indigenous to 
Chicago, they may easily be modified or adapted to the needs of other 
school systems. 

All professional staff from the Department of Government Funded Pro- 
grams serve as auditors in addition to their regular duties usually 
one-half day each week. Staff from other departments such as Curr1cu1um» 
principals, and field staff also serve as auditors. 

Added to the obvious benefits which auditing brings to program imple- 
mentation, there is another equally important benefit, that of staff 
development, which accrues to the audit. Personnel conducting audits 
have the opportunity to keep abreast of innovative educational techniques, 
and a mutual exchange of Ideas leads to strengthening the department 
and school team effort toward the improvement of educational opportunities 
for children. 

Two of the most important requirements for successful program 
auditing are objectivity and accuracy In observation and in reporting. 
Since all professional program personnel and occasionally others In the 
Department of Government Funded Programs serve on audit teams, the follow- 
ing procedures have been developed to ensure the achievement of both 
requisites: 

Two folders, one a duplicate, are prepared for each site. 
A list of ongoing programs at the site, all Information 
pertinent to the programs, and copies of all previous 
audit reports are kept in folders. Auditors review the 
information in the folders prior to an audit visit and 
take one folder on the visit. 
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Before an audit visit, auditors are requested to review 
the activity descriptions which apply to the programs 
they win observe. These descriptions are prepared by 
administrators and copies of those relevant to the school 
are filed in the individual audit folders. 

Two persons are usually sent to audit. This allows for 
a comparison of their observations. Moreover, if some- 
one new to the department is teamed with an experienced 
auditor, of if a person directly involved with a program 
and familiar with the guidelines is teamed with a person 
from an entirely different program, on-site inseryice 
is possible for the less experienced or less knowledgeable 
auditor. 

The same auditors are not sent to the same site for follow- 
up visits. A verif cation of the accuracy of previous 
reports is thereby provided. 

Inservice meetings are held to explain the sensitive role 
of the auditor, the type of information he is seeking, and 
the method of reporting audit findings. 

Audit Instruction sheets pertinent to particular audits are pre- 
pared and distributed. 

Proposals for all programs to be audited and copies of guidelines 
are kept on file and are available for review in the office of the Division 
of Program Audit. 
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PRESERVICE OF AUDITORS 

Because of the line-staff organizational structure In the Chicago 
public schools, auditors, who are staff personnel, are not empowered to 
judge the quality of teaching; their function Is limited to obtaining 
Information concerning staffing, the number and kinds of children served, 
the involvement of the community, and the availability and use of mate- 
rials and equipment prescribed by the proposal. During Inservlce training 
sessions this role Is emphasized, and It Is made clear to the prospective 
auditors that they are not to pass judgment upon the quality of the 
teaching In programs they are assigned to audit, since this is the 
responsibility of line officers (principals, district superintendents, 
and area associates). After completing the audit questionnaire, auditors 
return the form to the Division of Program Aur^lt, and it becomes the 
responsibility of the division to report audit exceptions or discrepancies 
to the proper administrative personnel. 

Before auditors can be selected or plans made for auditing, a bank 
of Information Is established to show In which schools programs are 
operating, and. In the case of schools having several programs, under 
which source each has been funded. This Information bank Is the respon- 
sibility of the Division of Program Audit, and It 1s updated as programs 
are added, dropped, or modified. 
Inservlce of the Auditors 

The training of auditors is the responsibility of the Division of 
Program Audit. Inservlce meetings for prospective auditors are held at 
the beginning of the school year and during the year as necessary. A 
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kit of materials for these meetings has been prepared, containing sample 
program descriptions end copies of questionnaires. Audit folders are 
distributed and reviewed at these meetings. A committee has been assigned 
to study the possibility of computerizing these data. 

The necessity for familiarity with the guidelines and the importance 
of the auditors' attitude are also emphasized during the inservice 
sessions. Personnel assigned to train auditors explain that their role 
Is one of service and it is important that they approach the schools in 
a spirit of cooperation in the task of providing the best possible 
programs for children. 

Response and feedback sessions for school personnel at the central 
office or In the field are also conducted during which the purpose of 
audit is explained and suggestions for its improvement are solicited. 
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TYPES OF AUDIT 



Generally, three types of program audit are performed during the 
school year by the Department of Government Funded Programs. The first 
Is an implementation audit. Its primary objective is the determination 
of whether the programs in the local schools are properly staffed and 
have received or ordered the budgeted amount of supplies and equipment, 
whether the students called for in the guidelines have been selected, 
and whether Instruction has begun. This audit is conducted during the 
first three weeks of school and Is confined to the examination of these 
elements, all of which may be verified Within the school office. It is 
designed to provide administrators with Immediate feedback regarding 
anything that may deter implementation of the program. 

The second audit involves not only the examination of Items found 
In the school office but also observation of all funded classrooms at 
the site. This audit begins during the fourth week of school. It in- 
volves follow-up on discrepancies noted in the first audit and verifies 
program Implementation through actual classroom observation. Individual . 
student records are examined to see If they conform to the selective 

criteria; classroom attendance and enrollment books are examined to 

I 

check the number of students served; materials and supplies are checked 
to determine their appropriateness and availability. ' 

The third audit begins in January as a follow-up at those units where 
discrepancies had previously been noted. This audit Involves the examina- 
tion of supplies, educational material, and equipment requisitions; 
documents describing the assignment and payment of staff; and program 



115 

BEST COPY AVAILABLE 

Implementation through visits to every classroom involved in any phase 
of government- funded programs. 

Special audits are performed to meet special needs. For example, an 
audit of all health service components of programs, of all mobile instruc- 
tional laboratories, or of the proper assignment of personnel In a 
program might be audited during a given week. Although these program 
components are to be spot-checked at each general audit, a more compre- 
hensive audit of them Is sometimes required. 
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AUDIT EXCEPTIONS 
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An audit exception is a discrepancy which exists between the proposal 

and its Implementation, For example, if a teacher is provided for a 

tutorial program, but his services are not used for that purpose, a 

violation exists, since most government-funded programs are designed to 

supplemant, rather than supplant, local programs. The following are general 

directions concerning audit exceptions. They apply to virtually all 

government-funded programs, and information concerning these should be 

checked during each audit visit. 

Staffing is checked at every visit to see that the 
Information at the central office coincides with that 
of the school and to determine whether there are any 
unfilled positions. Conformity of staff use is also 
checked. 

Accounting procedures for professional personnel in 
government-funded positions arc checked. Teachers 
should be charged to the correct account. 

Delivery of supplies and materials and prompt processing 
and return of invoices and receiving reports are checked 
during each visit. 

Lists of participating pupils and daily programs for 
both teachers and aides are checked to determine if the 
number of students is as stipulated and if the staff is 
used In accordance with the guidelines. 

Enrollment and observed attendance are noted. 

A spot-check of records of one or two students in each 
class is made in order to determine whether they are 
eligible for p?rticipation. Requirements for eligibility 
are listed in the guidelines. 

Current equipment inventories are required for all 
overnment- funded programs. Equipment must bear labels 
ndicating the funding source. Some programs have 
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special decals which are required for purposes of 
Identification. A spot audit of inventories should be 
ongoing throughout the year. 

Equipment purchased for government-funded programs 
should be readily available to the teachers in the 
program so that it can be effectively used. 

Books and kits purchased for government-funded programs 
should he stamped with identifying information. Mate- 
rials purchased for these programs are to be used in 
the program for which they were purchased and should be 
in evidence and in use in these programs. ESEA Title II 
materials should be spot-checked at every school to 
see that they are properly labeled. 

Evidence of the supplementary nature of the program 
should be checked. 

Report of Audit Exceptions 

Auditors of government- funded programs complete their report at the 
conclusion of the audit and submit the report to the coordinator of 
program audit. It then becomes the coordinator's responsibility to 
analyze the report to note any discrepancies; check program guidelines 
thoroughly to verify noted discrepancies as actual discrepancies; 
prepare a report of these discrepancies; and submit the report to the 
administrator of the Department of Government Funded Programs who then 
transmits these data to the appropriate line officer for correction. 
It Is the responsibility of line administrators to correct program dis- 
crepancies. 

In addition* the report is transmitted to bureau heads within the 
department and to other appropriate staff so that they may be aware of 
problems as early as possible anrf work to improve the services of the 
central office staff in those aspects of the program which are 
managerial in nature. 



- 16 - 

o 

ERLC 



BEST COPY AVAILABLE 



BENEFITS OF AUDIT 

Internal program audits should result in fewer violations of 
guidelines. A common understanding of and commitment to guidelines should 
lead to early implementation of programs to serve children. All adminis- 
trators should work together to ensure program compliance with guide- 
lines and program implementation at the earliest possible data. If, 
when programs become operative, it is shown that some component of the 
design Is unrealistic or impossible to implement, immediate steps should 
be taken to remedy the situation. Only through a structured program 
audit will the mechanism for correcting errors or misjudgments in 
program design be established. 

Several kinds of guidelines exist for funded programs: those Issued 
at the federal level in the legislation authorizing the program; those 
Implicit in state and city officials' interpretations of the acts and 
their amendments; and those developed at the local level for program 
Implementation. If guidelines are not closely followed by the personnel 
implementing government- funded programs, no meaningful evaluation is 
possible, and there is no objective way to determine the success or 
failure of a program. 

In the early days of government funded programs, guidelines were not 
always immediately available or, if available, their Interpretations by 
state and city officials were often late in coming. Therefore, at the 
Inception of government-funded programs, officials of school systems some- 
times implemented programs in accordance with their own Interpretation of the 
proposal. Experience has shown that through audit there 1s a more common 



BEST COPY AVAILABLE 

Interpretation of the intent of the legislation as well as an interpretati 
of the method in which programs must be implemented to conform ,0 the man- 
date of the funding agency. 

All activities of a school system should result in improved educa- 
tional benefits for children. Sometimes it is difficult to see a meaning- 
ful and positive relationship between the technical aspects of management 
and the improvement of educational opportunities. for the child in the 
classroom. If that relationship does not exist, however, the activity is 
Invalid. 

In program audit, however, a concommitant relationship exists 
between the function and the children. While value judgments are not 
within the scope of the auditors, the information gathered through audit 
leads to Improvement in programs for the benefit of the child. Early 
feedback based on teachers' and principals' comments concerning the 
effectiveness of the program allows for Immediate amendments or total 
modifications for the next fiscal year through planning sessions in 
which staff and community are involved. When these results occur, the 
children benefit. 
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USE OF PROGRAM AUDIT FOR TOTAL OPERATION 



Accountability is strengthened when internal program auditing is used 
throughout a school system. The cechniques developed by the Depart- 
ment of Government Funded Programs are easily adaptable. 

Several steps precede the inauguration of such a program. Establish- 
ment of goals and objectives not only of program audit itself, but also 
of subject areas, is one such step. This can be accomplished by assigning 
to the task personnel with expertise in the field, by submitting sugges- 
tions of this task force to a larger group for recornmendations and 
revisions, and, finally, by disseminating Information regarding all 
elements of the proposed program to school and community affected by 
Its Inauguration as each step progresses. Whatever threat is posed by 
the adoption of a monitoring system may easily be dispelled by open and 
frank discussions through workshops and inservice meetings and through 
frequent communications, possibly through bulletins, which reiterate 
the rationale behind the adoption and the gains to be received by all 
concerned. 

It should be emphasized that accountability can only be achieved 
through systematic checks and balances and that an ongoing analysis of 
the various functions of a school system, including that of the admini- 
strative function, by staff of the system leads to overall improvement. 
Since this is a cooperative effort toward total accountability, whatever 
changes are necessary to accomplish the end can be made quickly, and, 
since program audit uses the talents of staff who perform this function 
In addition to their regular duties, costs are reduced to a minimum. 
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Finally, if large and small school systems throughout the nation 

were to adopt a policy of Internal program auditing, several educational 

benefits would accrue to all. Among thesQ benefits are the following: 

In funded programs, school systems and the state would 
more likely be in accord In the intet pretation of guide- 
lines and there would be greater consistency In the imple- 
mentation of programs. 

Where many school systems were finding legislation and 
resultant guidelines unrealistic more pressure could be 
brought to bear upon legislators and government officials 
to make realistic changes. 

« 

An exchange of Ideas among school systems concerning suc- 
cessful monitoring procedure? for all educational programs 
as well as techniques employed Ic analyze and Improve 
operations would Improve the efficiency of school systems 
and enhance accountability. 

Educational program audit on a national scale could well 
become a tool through which efficient management of 
school systems and quality educational programs In every 
school might evolve so that every child in the United 
States might meet his full potential. 
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APPENDIX 

The following program audit questionnaires were designed by staff 
of the Department of Government Funded Programs, 

The first is used for all Title I programs as well as for other funded 
programs. 

The second is typical of questionnaires for programs having additional 
specifications which are not common to all programs. 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 



Program Audit Checklist 



General Information 



School 



Audi tor (s) 



Activities 



Date 



1. STAFFING 

a. Does staffing at the school coincide with our staffing Information? List 
any discrepancies. 

b. List by activity any unfilled positions. 



c. Are teachers charged to the correct position numbers? Verify four teach 
ing position numbers by asking the teachers in what activity they are 
working and checking the division openings for these. 



2. HT.TERIALS. SUPPLIES. EQUIPMENT 



a. Approximately what percent of the materials and supplies were not delivered 
as of the audit date? 



ActivTW 



Professional 



Position No. 



Paraprofessional 
Acti v1 ty 



b. Did the materials for structured reading programs arrive on time? If not, 
indicate the activities for which they were not delivered. 
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c. List materials and numbers of purchase orders over the amount of $100 that 
have not been delivered as of the audit date. Give the date of the 
requisition. (Comprehensive audit only) 



d. List equipment and the purchase order numbers that have not been delivered 
as of the audit date. Give the date of the requisition. 



e. Please remind the principal that Invoices must be returned immediately. 



f. Is there an updated inventory of equipment? Spot-check at least four items. 



g. For structured programs is the equipment necessary for the operation of 
the activity functioning and located in its appropriate setting? 



3. COMMUNITY INVOLVEMENT 

a. Is there a separate advisory council for government-funded programs? 

If not, how often are government- funded programs discussed at regular 
council meetings? 

b. When and how frequently does the advisory council meet? 

c. How many members are on the council? 

d. What percent are parents? 
4. INSERVICE 



a. What inservice do professional and paraprofessional personnel in govern 
ment- funded programs receive? 
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b. Briefly describe your inservice programs for government- funded personnel. 



c. Who conducts the insen-ice? 



5. DISSEMINATION 



How is information concerning government-funded programs disseminated? 
(Have the princioal fill out the form prepared by Editorial and Communi- 
cation Services.) 



CLASSROOM OBSERVATION 

The infonnation pertinent to the following questions is to be filled in 
on the form provided. Directions concerning use of this form are printed ( 
its reverse side. 

a. Check test scores of one or two eligible pupils in each class to determine 
whether they meet eligibility guidelines. 

b. Is staff used in conformity with stipulated guidelines? (If not, note 
discrepancies.) Check schedules of teachers and paraprofessionals. 



d. Is equipment for the program properly labeled? Check for items. 



d. Is equipment available for classroom use? 



e. Check for conformity and availability of instructional materials with the 
correct activity. Note this on the form provided. 



f. According to the teacher's class list and daily time schedules, how many 
children are being served daily in each class? Note observed attendance. 



Are there time conflicts which reduce the time the child participates in 
the core programs. List them. 
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h. Are books properly labeled with the information concerning the funding 
source and in evidence in the classroom? 

i. Are the Title I participants involved in other Title I activities? Indicate 
this in the column labeled Observed Supportive Services , List the numbers of 

pupils so involved. 

j. Are Title II materials properly labeled and is there an inventory of these? 
(These are to be in the school library with the teacher librarian) 

7. COMMENTS 

a. Principal's comments. 



b. Auditor's comments. Do the programs appear to be operating within guidelines? 



ft 



> Id 

> u o 
u u ^ 
V o > 
« a v« 

O 3 CO 




1 


! 


























Cu m 

O rH 
a *^ 

< s 
































stamped 
Books 
































Labeled 
Equip. 
































« 

CO 
































Seiec.of 
Pupils 


CM 
































































Observed 
Attend. 


















• 














09 iH 

cH d 
































Dally 
Enrl. 
































Activity 
































Grade 
































I 

a 

0 • 

0 0 










n 


nn 




iao3 


iS3l 















U 

o 

d 
4) 
> 

0 
H 



d 

CO 



H 
«} 
v4 
Ki 
4) 
4J 

id 



BEST COPY mmix, 

DEPARTMENT OF GOVERNMENT FUNnED PROGRAMS 
Procrara Audit Checklist 
Head Start 
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school ■ Auditor(s). 



Activity 



1. List any unfilled positions 



2. Is the atafi.' being utilized according to guidelines? 



3. Were two volunteers present? 

Check volunteer schedule and time sheet. Total volunteer time 
should be 60 hours per week. 

A. Check the inservicc schedule. Teachers and aides are to have the 
equivalent of three hours of inservicc per month. 

5. Is there an updated inventory of equipment? Are items properly 
labeled? 

6 Check nutritional program. Is food served family style in the 
cl'a^sr^^m? Is s%aff It the tables with the children during the 
nutrition program? Is staff eating the same food and drinking 
the same beverage as the children? 



7, Check medical - dental services. Have examinations been given? 
Scheduled? 

* 8 Snot check every fifth enrollment form to determine whether the 

pupnneets the means test. (Copies of the fee schedules and the 
enrollment form are attached). Indicate any discrepancies below 
or write "none", if none exist. 
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9. Indicate Ualiy class schedule: 

AM Storts ' PM Starts 

t 

AM Ends PM Ends 



10. AM Enrollment Observed Attendance 

PM Enrollment " Observed Attendance 



(*) Mo pupils are to be enrolled If the family Income 
requires a fee. 



9/7/73 
DJ: ap 
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RULES AND RHGULATIONS 
Head Start Fee Schedule, Monthly Charge 



I 



annual 
Income 



Number of chtldron i n family 



6 



)-$A,320 

21-A,575 

76-4,900 

)l-5,225 

i6-5,550 

51-5,875 

?6-6,200 

)l-6,525 

26-6,850 

51-7,175 

76-7,500 

51-7,825 

26-8,150 

51-8, A75 

76-8,800 

01-9,125 

26-9,459 

51-9,775 

76-10,100 

01-10, 

26-10,750 

51-11.075 

^6-11,400 

p-11,725 

fl-12,050 

51-12,375 

76-12,700 

01-13,025 

26-13,350 

51-13,675 

76-14,000 

01-14,325 



0 
X 

$2.50 
5.00 
7.50 
10.00 
12.50 
15.00 
19.00 
23.00 
27.00 
31.00 
41.00 
51.00 
61.00 
71.00 
87.00 
103.00 
119.00 
135.00 



, 0 
X 

$2.50 
5. 00 
7.50 
10.00 
12.50 
15.00 
19.00 
23.00 
27.00 
31.00 
41.00 
51.00 
61.00 
71.00 
87.00 
103.00 
119.00 
135.00 



0 

X 

$2.50 
5.00 
7.50 
10.00 
12.50 
15.00 
19.00 
23.00 
27.00 
31.00 
41.00 
51.00 
61.00 
71.00 
87.00 
103.00 
119.00 
135.00 



0 
X 

$2.50 
5.00 
7.50 
10.00 
12.50 
15.00 
19.00 
23.00 
27.00 
31.00 
41.00 
51.00 
61.00 
71.00 
87.00 
103.00 
119.00 
135.00 



0 

X 

$2.50 
5.00 
7.50 
10.00 
12. 50 
15.00 
19.00 
23.00 
27.00 
31.00 
41.00 
51.00 
61.00 
. 71.00 
87.00 
103.00 
119.00 
135.00 



0 

X 

$2.50 
5.00 
7.50 
10.00 
12.50 
15.00 
19.00 
23.00 
27.00 
31.00 
41.00 
51.00 
61.00 
71.00 
87.00 
103.00 
119.00 
135.00 



0 
X 

$2.50 
5.00 
7.50 
10.00 
12.50 
15.00 
19.00 
23.00 
27.00 
31.00 
41,00 
51.00 
61.00 
71.00 
87.00 
103.00 
119.00 
135.00 



0 

X 

$2.50 
5.00 
7.50 
10.00 
12.50 
15.00 
19.00 
23.00 
27.00 
31.00 
41.00 
51.00 
61.00 
71.00 
87.00 
103.00 
119.00 
135.00 



atutory maximum allowable fee charge is marginal. No fee will be assessed. 

— To allots for higher costs of living In Alaska and Hawaii, multiply family 
me by 0.8 and 0.87, respectively, and correlate the lowered Income figure with 
fee. This variation complies with the statutory language mandating that the 
sc.hedule must be based upon the ability of thefamily to pay. A family with 

more children enrolled shall pay one full fee for the first 2 children, and 
ercent of that full fee for each additional child. The above fee R'^hcdule 
les to both farm and nonfarm families. A family whose ability to pay has 

impaired because of unusual medical and dental expenses or unusual casualty 
heft loss(es) shall be eligible for a reduction on fee charge if the amount 
nusual expenses exceeds 10 percent of the annual gross family income. 



\ 



^,86 Stat. 690 (42 U.S.C. 2809 (a) (1)); sec. 602 (n), 78 Stat. 530 (42 U.S.C. 
"^f»)); Delegation of Authorities to Secretary of Health, Education, and ' 
«fc, 34 FR 11398) I 

ctive date. — The regulations in this section shall be effective April 16, 1973. 
d Anj^l 11, 1973. Caspar W. Weinberger, Secretary 

ERIC 



PRCCRAT-l: 
lEAO START-Half Day 
EAO START-Ful 1 Day 
17LE IV-A-Full Day 
ITLE I V-A-Bef ore/After School 
ITLE IV-A-Infant Care 



CHILDREN 'iJ SERVICE'S DIVISION 

KNr<or.t,;i]:rn. R>,^M BEST COPY AyfULABLE 

1 . ^GEUCi 
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CHILD'S Iw\M23 



2. SITE 



3. SITE ADDRESS 





□ NO 



7. ETHNIC ORIGIN 

□Black □ Puerto Rican 
□ White Dt'^v % 

□ n>-i«.«4-.i i=f^*®^« American . 

r^Ztr-T Q^'^^^^^ Latin 
Indian 




HILD LIVIS Willi: 

Both Mother & 
Father 

Mother 
Father 
fuardian 




13. HEAD OF HOUSEHOLD 
Q Father 
□ IJoUxer 
D Guardian 
D Other 



>OS£KOLU lasilBERS : 



14. l'7J-IILy INCOME 

TOTAL ANNUAL INCOME 



Number 
in 

.Household 



15. &uUl.CE(S) OF IKCOI-IE: 

□ Private Ejr.ployment □ social Security 

□ Government Llaployment □ other Bf^ncfits 

□ Public Assistance p oUior 




I declare that the above statements 



are true and complete. 
DATE: 



Area 



APPENDIX H 

PROGRAM AUDIT /!89^'aa 
GOVERMMENF FUNDED PROGRAMS SUMMER READING CENTERS "^"^^ 

BEST COPY AVAILABLE 



District 



SCHOOL 



DATE 

OBSERVER 



PROGRAM 



ACTIVITY 




I. Staff 

K, Allocated positions filled 

1. Professional 

2. Paraprofessional 

II. Pupils 

ST Eligible for participation 

B. Grade level as specified 

Number as specified 
D. Nonpublic pupil participation 

III. Program 

A. Organization of classes 

1. Small group 

2. Individualized 

3. Grouped and regrouped for instruction 

B. Materials and equipment 

1 . Ordered 

2. In use 

3. Supplementary 

4. Relevant 

C. Instruction 
Planned in terms of goal attainmant 



1 



2. Directed to meet special needs 
■ and interests 

3. Provides opportunity for frequent 

pupil/teacher interaction 



YES 


NO 




































































o 

ERIC 



2- 



4. Appropriate and varied utilization 

a. Approaches 

b. Materials 

c. Equipment 

0. Evaluation 

1. Standard tests of achievement admin. 

2. Attitudes and behavior scales 

administered 

3. Status of ongoing valuation 

a. Type 

b. Frequency 

c. Quality 

IV. Atmosphere 

A. Orderly and attractive 

B. Functional room arrangement adaptable to 
pupils' needs and interests 

C. Interest centers 

1. Appropriate for age and grade level 

2. Utilized effectively 

3. Providing stimulating experiences 

and materials 
0. Displays 

1 . Meaningful 

2. Current 

3. Functional 

4. Attractive 

V. Supportive Services 
A. Participation 

1. Cluster Closed-Circuit Television 

2. Outdoor Education and Camping 

3. Field Experiences 

4. Health Services 

5. Inscrvice on V/heels 

6. School -Community Identification 



ERIC 



VI. Insorvice Program 

A. Regularly scheduled 

1 . Local 

2. District 

3. Area 

B. Provided by 

1. School administration 

2. Staff assistants 

3. Other (Specify) 

C. Provides for joint participation of pro- 
fessionals and paraprofessionals 

D. Type 

1 . Lecture 

2. Demonstration 

a. Group meetings 

b. Classroom 

E. Objectives 

1. Appropriate 

2. Realistic 

3. Well-defined 

F. Effective in achieving objectives (evalua 
tion of local administration) 

VII. Parental and Community Involvement 

A. Advisory Councils 

1. Established 

2. Conformity with formula 

a. Percentage of parents 

b. Community leaders 
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YES 


NO 
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3* Regular scheduled meetings 

a. Weekly 

b. Bi-monthly 

c. Monthly 
4, Activities 

a. Discussions 

b. Guest speakers 
c* Demonstrations 

d. Classroom visitations 

B. Involvement 

1. Assessment of needs 

2. Determination of priorities 

3. Evaluation of exsting programs 

4. Planning and evaluation new programs 

C. Sign off sheets 

VI II. Dissemination of Information 

A. Type . 

B. Distribution 

General Comments 



YES 


... 

NO 




I* 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 

Audit Infonnation Sheet 
First Visit 1971-72 

School^ Auditor 

Activity Date 



1. Does the staffing at the school coincide with our staffing information? 
List any discrepancies by activity. 



2. List any unfilled positions by activity: 

Professional Par aprofessional 
Position Number Activity RcRvity 



3. What was the actual attendance in each class at the time you visited? 
Room No. Observed Attendance 



4. According the the teacher's class list and daily time schedule, how many 
children are being served daily in each class? 

Room No. Daily Membership 



5. Was staff utilized in conformity to with stipulated guidelines. If not, 
note the discrepencies. 



6. Was there an updated inventory of equipment? Was it properly labeled? 
Was it in a place accessible to the program? 



7. V/as there an updated inventory of textbooks, kits, etc.? Were they stamped 
with identifying information? 



ERIC 
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8. Was the staff being utilized for recess, lunch, or office duty? 

9, Are invoices being processed and returned to us promptly? 

Principal's comments or suggestions. 



11. Auditor's comments or suggestions. 



S 

ERJ.C 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
Program Audit - Summer Reading Centers 



Area 



District 



Date 



School 



Observer 



Program 



Activity 



Items in the following checklist indicate whether the operation of the program is 
in conformance with the proposal and federal and state guidelines. This report 
will serve to identify any misinterpretations or deviations which may lead to an 
audit exception. 



I. Staff 

Kl Allocated positions filled 

1. Professional 

2. Paraprofessional 

B. Proper staff utilization 

II. Pupi 1 s 

A. Eligible for parti cipati- 

B. Grade Level as specified 

C. Number as specified 

D. Nonpublic pupil participation 

III. Program 

A. Organization of classes 

1. Small Group 

2. Individualized 

3. Grouped and regrouped 

for instruction 

B. Materials and equipment 

1 . Ordered 

2. In use 

3. Supplementary 

4. Relevant 



YES 


NO 


COMMENT 























































































I 



-2- 



141 



C. Instruction 

1. Planned in terms of goal 
attainment 

2. Directed to meet special 
needs and interests 

3. Provides opportunity for 
frequent pupil /teacher 
interaction 

4. Appropriate and varied 
utilization 

a. Approaches 

b. Materials 

c. Equipment 

D. Evaluation 

1. Standard tests of achieve 
ment administered 

2. Attitudes and behavior 
scales administered 

3. Status of ongoing 
evaluation 

a. Type 

b. Frequency 

c. Quality 

IV. Atmosphere 

A. Orderly and attractive 

B. Functional room arrangement 
adaptable to pupils' needs 
and interests 

C. Interst centers 

1. Appropriate for age 
and grade level 

2. Utilized 
effectively 

3. Providing stimulating 
experiences and 
materials 

D. Displays 

1. Meaningful 

2. Current 

3. Functional 

4. Attractive 



YES 


NO 


COIIMCNT 
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Supportivo Services 
A. Participation 

1. Cluster Closed-Circuit 
Television 

2. Outdoor Education and 
Camping 

3. Field 
Experiences 

4. Health 
Services 

5. Inservice on 
Wheels 

6. School -Community 
Identification 

Inservice Program 

A. Regulary scheduled 

1. Local 

2. District 

3. Area 

B. Provided by 

1. School administration 

2. Staff assistants 

3. Other (Specify) 

C. Provides for joint partici- 
pation of professionals and 

D. Type 

1 . Lecture 

2. Demonstration 

a. Group meetings 

b. Classroom 

E. Objectives 

1. Appropriate 

2. Realistic 

3. Well-defined 

F. Effective in achieving objec 
tives (evaluation of local 
administration) 



YES 


NO 


COMMENT 






























































• 
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VII. Parental and Con:munity InvolvemGnt 

A. Advisory Councils 

1. Established 

2. Conformity with formula 

a. Percentage of parents 

b. Community leaders 

3. Regular scheduled meetings 

a. Weekly 

b. Bi-monthly 

c. Monthly 

4. Activities 

a. Discussions 

b. Guest speakers 

c. Demonstrations 

d. Classroom visitations 

B. Involvement 

1. Assessment of needs 

2. Determination of 
priorities 

3. Evaluation of existing 
~ programs 

4. Planning and evaluating 
new programs 

C. Sign-off sheets 

VIII Pi sseni nation of Information 

A. Type 

B. Distribution 

General Comments: 



YES 


NO 


COMMENT 


















































• 
















— — . ■ 
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APPENDIX #5 



DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
Program Audit Checklist 
General Information 
ESEA Title I 

School . Auditor(s) 

Activity Date 



1. a. Does staffing at the school coincide with our staffing information? 
List any discrepancies. 



b. List by activity any unfilled positions. 

Professional Paraprofessional 
Position Number & Activity Activity 



c. Are teachers charged to the correct position number? 



2. a. Approximately what percent of the materials and supplies were not 
delivered as of the audit date? 



b. List materials and purchase order numbers over the amount of $100 
that have not been delivered as of the audit date. Give the date 
of the requisition. 



-2- 
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c. List equipment and purchase order numbers that have not been 

delivered as of the audit date. Give the date of the requisition. 



d. Are invoices or packing slips being processed and returned to the 
Division of Administrative Services promptly? 



Is there an updated inventory of equipment? 



a. What is the extent of community involvement in the program? 



b. Is there a separate advisory council? If not, how often are^ 
government-funded programs discussed at regular council meetings? 



c. When and how often are council meetings held? 



d. How many members are on the council? 



e. What percent are parents? 



a. What inservice do professional and paraprofessional personnel 
government- funded programs receive? 



b. Who provides the inservice? 



How is information concerning programs disseminated? 
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7. According to the teachers' class lists and daily time schedules, how 
many children are being served daily in each class? Note observed 
attendance. 



Activity Grade/Room Number Enrollment Observed Attendance 



-5- 
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8. Check test scores of one or two pupils in each class to determine 
whether they meet eligibility guidelines. 



9. Is staff used in conformity with stipulated guidelines? If not, note 
discrepancies. Check schedules of teachers and paraprofessionals. 

10. a. Is equipment for the program properly labeled? 
b. Is equipment available for classroom use? 

11. Are books stamped with identifying information and in evidence in the 
classrooms? 

* 

1?. Are Title II library materials properly labeled, and is there an 
inventory of these? 



13. Comment on supportive services you observed. 



14. Principal's comments. 



15. Auditors' comments. 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 



Ai'^it Information Sheet 



Model Cities 



School 



Auditor 



Activity 



Date 



1. Does staffing at the school coincide with our staffing information? 
List any discrepancies by activity. 



2. List any unfilled positions by activity. 



3. a. Have orders for supplies, materials, and equipment been submitted? 

b. List materials which have not been received within two months of 
the date of the order. 



4. Are invoices being processed and returned to us promptly? 



5. a. Do paraprofessionals live in the target area? 
b. How is this determined? 



Professional 
Position Number 



Activity 



Paraprofessional 
Activity 



2 
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6. a. Was there an updated Inventory of equipment? 

b. Was equipment properly labeled? 

c. Was equipment readily available for classroom use? 

7. Were books stamped with identifying information? 



8. Are instructional aides attending college classes regularly? 

9. Are teacher aides being utilized according to guidelines? If not* 
note discrepancies. 



10. Are Instructional team leaders being utilized according to guidelines? 



11. Describe the activities of the medical and dental components. If 
they are currently st the school observe teams in action. How many 
children were served daily? Have examinations been given? Scheduled? 



12. a. According to the teacher's class list and daily time schedule, how 
many children are being served daily in the scheme? 



b. How were the children selected? 



13. Describe the activities of the parent component in the schome. 



14. Principal's comments. 



15. Auditor's comments. 



DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
Audit Information Sheet 
Model Cities 

School Auditor_ _ 

Free Breakfast 

Inservice Date ; 

1. Is there an updated inventory of non-expendable property? 



2. Are the proper decals affixed to Model Cities property? 



3. Have the inservice plans been formulated? Check the schedule. 



153 



MODEL CITIES PROGRAM 
AUDIT iriFORMATION SHEET 



School Audi tor (s). 

Activity Date 



1. What time did the Food Handlers report to work? 



2. How many Food Handlers are employed? 



3. How many Lunchroom Porters are employed? 



4. Are you over staffed, under staffed or neither? Comments. 



5. Describe v/hat the Food Handlers and/or Porters were actually doing at 
the time of your visit. 



6. Is a weekly manpower report called in to the District Office each Friday? 



7. What is the average number of children served daily? 



8. What was the actual number of children participating at the time you 
visited? 



9. What was the menu at the time of your visit? 
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School^ 

Act! vit y 

10. What was the amount of throw-away (food). 

11. Is there an updated inventory of non-expendable property? 

12. Are the proper decals affixed to Model Cities property? 

13. Is the Breakfast Program suspended for teacher in-service training? 
If so, how often? 

14. Have the inservice plans been formulated? Check the schedule.- 

15. Has the school ordered any consumable supplies for the Breakfast 
Program under Model Cities? 

16. Has the school established a regular procedure for parents meeting 
the income eligibility requirement to make affidavit for free meal 
services al Ihe same time children are being enrolled? 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
Audit Information Sheet 
Gifted Program 

School Audi tors 

Activity \ Date 



Starting Date of No. of Students 
Progra m by Grade 



1. Does the program present an- offering in place of 
rather than in addition to the student's regular 

program? Yes No_^ 

2. Are children placed out of certain aspects of 
the regular program as a consequence of gifted 

program participation? Yes No_ 

3. Is a multiple identification and selection criteria 

being used in the program? Yes No_ 

4. Do identification and selection factors include 

objective data? Yes No_ 

5. Do the identification and selection practices meet 
the minimum criteria stated in the original 

proposal? Yes__ No_ 

6. Does the number of students in the program approxi- 
mate the number of students stated in the original 

proposal? Yes No_ 

7. Are the students involved in the program at least 

150 minutes per v/eek? Yes No_ 

8. Do the activities in the program take place during 

the regular school year? Yes No_ 

9. Does student participation in the program activities 

seem generally to be high? Yes No_ 

10. Are materials and services being purchased necessary 

to the activities which comprise the program? Yes No_ 



o 

ERIC 
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12. Are prog.'a.n funds beinq utilized mainly for program 
development rather than program maintenance? 
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11. Does the tcochcr in the program have access to all 

materials purchased specifically for the program? Yes No^ 



Yes No 



I 



ERIC 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
Audit Information Sheet 
ESEA TITLE I - Focus Area Schools 

School Auditor_ 

Activity Date 



1. Does staffing at the school coincide with our staff inforniation? 
List any discrepancies by activity. 



2. List any unfilled positions by activity. 
Professional 

Position No. Activity 



ERIC 



Paraprofessional 

Title Activity 
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3. Has all testing been completed and have the tests been returned? 



4. Has a list of identified Title I pupils participating in the various 
programs been submitted to Research and Evaluation? 
Due date was October 29. 



5. a. Have orders for supplies, materials, and equipment been submitted? 



b. List materials which have not been received within two months 
of the date of the order. 



6. Are invoices being processed and returned to us promptly? 



ERIC 
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What was the actual attendance in each class at the time you visited? 
Activity Grade/Room No. Observed Attendance 



According to the teacher's class list and daily time schedule, how 
many children are being served daily in each class? 

Activity Grade/Room No. Observed Attendance 



Check test scores of one or two pupils in each class to determine 
whether they meet eligibility guidelines. 



Was staff utilized in conformity with stipulated guidelines? 
If not, note discrepancies. 



a. Was there an updated inventory of equipment? 



b. Was the equipment properly labeled? (If there is no inventory 
tell the prinicpal that printouts and instructions for an 
inventory will be made available after January 1972.) 



c. Was equipment readily available for classroom use? 



4- 
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12. Were books stamped with identifying information and utilized by 
the Title I teacher? 



13. Was the staff being utilized for recess, lunch» or office duty 
more often than other teachers and aides? Check daily programs. 



14. Principal's comments or suggestions. 



15. Auditor's comments or suggestions. 



ERIC 
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16. a. Please Cu'nent on supportive services that you observed 
on the day of the audit. 
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Are books for Horizons Ahead being used in the program and 
are they properly labeled? 



ERIC 



DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
EEA Programs Audit Information Sheet 

School^ Auditor 

Date 

1. Does the staffing at the school coincide with our staffing 
information? List any discrepencies. 



2. List any unfilled positions: 



3. Was staff utilized in conformity with stipulated guidelines? 
If not, note the discrepencies. 



4. Was the staff being utilized for recess, lunch, or office duty? 
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5. Has there been any counseling of the participants? 
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6. Have any interviews been scheduled for the participants? 



7. Principal's comments or suggestions. 



8. Auditor's comments or suggestions. 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 

Follow Through Programs Audit Checklist 

School Auditor 

Activity Date 

1. List any unfilled positions. 



2. Is the staff being utilized according to guidelines? 

3. Were volunteers present? 

Check volunteer schedule and time sheet. Total volunteer time should 
be 60 hours per week. 

4. Check the Inservlce schedule. Teachers and aides are to have the 
equivalent of three hours of Inservlce per month. 



5. If there an updated Inventory of equipment? Are Items properly 
labeled? 



Check medical - dental services. Have examinations been given? 
Scheduled? 



Indicate daily class schedule for Kg: 

AM Starts PM Starts 

AM Ends PM Ends _ 



Indicate daily schedule for primary grades. 



How often does Parent Advisory Council (PAC) meet? 



DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
EPDA Programs Audit Form 

School Auditor 

Date 

1 . Was the weekly schedule checked? 

2. Are there unfilled positions? How many? 



3. Are the participants carrying a sufficient class load? 



4. What was the attendance level at the classes? 



5. Were 75% of the participants Model Cities area residents? 



6. Were there 25% spanish-speaking residents participating? 
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APPENDIX §6 

DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 

Program Audit Checklist 
General Information 

School Audi tor (s )_ 

Activities Date 

1. STAFFING 

a. Does staffing at the school coincide with our staffing information? 
List any discrepancies. 



b. List by activity any unfilled positions. 

Professional Paraprofessional 
Activity Position No. Activity 



• c. Are teachers charged to the correct position numbers? Verify 
four teaching position numbers by asking the teachers in what 
activity they are working and checking the division openings 
for these. 



2. MATERIALS. SUPPLIES, EQUIPMENT 

a. Approximately what percent of the materials and supplies were not 
delivered as of the audit date? 



b. Did the materials for structured reading programs arrive on time? 
If not, indicate the activities for which they were not delivered. 



Page 2 

Program Audit Checklist 



168 



c. List materials and numbers of purchase order over the amount of 
$100 that have not been delivered as of the audit date. Give the 
date of the requisition. (Comprehensive audit only.) 

d. List equipment and the purchase order numbers that have not been 
delivered as of the audit date. Give the date of the requisition. 



e. Please remind the principal that invoices must be returned immediately.- 

f. Is there -•'n updated inventory of equipment? Spot-check at least 
four items. 



For structured programs, is the equipment necessary for the operation 
of the activity functioning and located in its appropriate setting? 



3. COMMUNITY INVOLVEMENT 

a. Is there a separate advisory council for government-funded programs? 
If not, hov/ often are government-funded programs discussed at 
regular council meetings? 

b. When and how frequently does the advisory council meet? 

c. How many members are on the council? 

d. What percent are parents? 

4. INSERVICE 

a. What inservice do professional and paraprofessional personnel in 
government-funded programs receive? 



b. Briefly describe your inservice programs for government-funded 
personnel . 
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Program Audit Checklist 
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c. Who conducts the inservice? 



5. DISSEMINATION 

How is information concerning government-funded programs disseminated? 
(Have the principal fill out the form prepared by Editorial and 
Communication Services.). 



6. CLASSROOM OBSERVATION 

The information pertinent to the following questions is to be filled 
in on the form provided. Directions concerning use of this form are 
printed on its reverse side. 

a. Check test scores of one or two eligible pupils in each class to 
determine whether they meet eligibility guidelines. 

b. Is staff used in conformity with stipulated guidelines? 

(If not, note discrepancies.) Check schedules of teachers and 
paraprofessionals. 

c. Is equipment for the program properly labeled? Check for items. 



d. Is equipment available for classroom use? 

e. Check for conformity and availability of instructional 
materials with the correct activity. Note this on the form 
provided. 

f. According to the teacher's class list and daily time schedules, 
how many children are being served daily in each class? No'.e 
observed attendance. 



g. Are there time conflicts which reduce the time the child 
participates in the core programs. List them. 
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Program Audit Checklist 
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h. Arc books properly labeled with the information concerning the 
funding source and in evidence in the classroon;? 

1. Are the Title I participants Involved in other Title I activities? 
Indicate this in the column labeled Observed Supportive Services « 
List the numbers of pupils so involved. 

j. Are Title II mateirals properly labeled and is there an inventory 
of these? (These are to be in the school library with the 
teacher librarian.) 

7. COMMENTS 

a. Principal's comments. 



b. Auditor's comments. Do the programs appear to be operating within 
guidelines? 
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AUDITOR'S INSTRUCTIONS 



Classroom Observation 



Columns 1 through 6 



Selection of Pupils 



Staff Use 



labeled Equipment 



- Record the room number, grade, activity, 
daily enrollment, class enrollment, and 
observed attendance for each room with 

a government- funded program. 

- Check the test scores of one or two pupils 
in each class to determine whether they 
meet eligibility guidelines. Use "Yes" or 
"No" in column. Explain discrepancies 
under "auditor's comments." 

- Note any discrepancies observed in the use 
of staff using "C" for conformity and "N" 
for non-conformity. Explain discrepancies 
under "auditor's comnents." 

- Is equipment properly labeled? 



Stamped Books 



Are the books stamped with identifying 
information? 



Appropriate Mater'' als 



Observed Supportive 
Services 



Are Title I materials available in the Title 
I class? If programs are structured are 
the designated materials being used? Use 
"Yes" or "No" in the column. Explain 
discrepancies under "auditor's comments." 



- Comment on supportive services observed. 



Title II Library Materials 



Are Title II library materials properly 
labeled, and is there an inventory of these? 
(These are to be checked in the school 
library with the teacher-librarian.) 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 

Program Audit Checklist 
Head Start 

School , Audi tor (s). 

Activity Date 
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1. List any unvilled positions. 

2. Is the staff being utilized according to guidelines? 

3. Were two volunteers present? 

Check volunteer schedule and time sheet. Total volunteer time should 
be 60 hours per week. 

4. Check the inservice schedule. Teachers and aides are to have the 
equivalent of three hours of inservice per month. 

5. Is there an updated inventory of equipment? Are items properly labeled? 

6. Check nutritional program. Is food served family style in the classroom? 
Is staff at the tables with the children during the nutrition program? 

Is staff eating the same food and drinking the same beverage as the 
children? 



7. Check medical - dental services. Have examinations been given? 
Scheduled? 

8 Spot check every fifth enroll r.ent form to determine whether the pupil 

meets the rreans test. (Copies of the fee schedules and the enrollment 

form are attached.) Indicate any discrepancies below or write "none," 
if none exist. 

9. Indicate daily class schedule: 

AM Starts PM Starts 

AM Ends Ends . 



(*8. No pupils are to be enrolled if the family incoruC requires a fee.) 
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RULES AMD REGULATIOtIS 
Head Start Fee Schedule. Monthly C!|g| ^ f^^„fjg^^'^ 



aYoss annual Number of Children in Family 

ami 1 V income 1 2 3 4 5 6 7 8 



0- 4,320 0 0 

4,321- 4,575 X X 

4,576- 4,900 2.50 2.50 0 

4,901- 5,225 5.00 5.00 X 

5,226- 5,550 7.50 7.50 2.50 0 

5,551- 5,875 10.00 10.00 5.00 X 

5,876- 6,200 12.50 12.50 7.50 2.50 0 

6,201- 6,525 15.00 15.00 10.00 5.00 X 

6,526- 6,850 19.00 19.00 12.50 7.00 2.50 0 

6,851- 7,175 23.00 23.00 15.00 10.00 . 5.00 X 

7,176- 7,500 27.00 27.00 19.00 12.50 7.50 2.50 0 

7,501- 7,825 31.00 31.00 23.00 15.00 10.00 5.00 X 

7,826- 8,150 41.00 41.00 27.00 19.00 12.50 7.50 2.50 0 

8,151- 8,475 51.00 51.00 31.00 23.00 15.00 10.00 5.00 X 

8,476- 8,800 61.00 61.00 41.00 27.00 19.00 12.50 7.50 2.50 

8,801- 9,125 71.00 71.00 51.00 31.00 23.00 15.00 10.00 5.00 

9,126- 9,459 87.00 87.00 61.00 41.00 27.00 19.00 12.50 7.50 

9,460- 9,775 103.00 103.00 71.00 51.00 31.00 23.00 15.00 10.00 

9,776-10,000 119.00 119.00 87.00 61.00 41.00 27.00 19.00 12.50 

0,101-10,425 135.00 135.00 103.00 71.00 51.00 31.00 23.00 15.00 

0,426-10,750 119.00 87.00 61.00 41.00 27.00 19.00 

0,751-11.075 135.00 103.00 71.00 51.00 31.00 23.00 

1,076-11,400 119.00 87.00 61.00 41.00 27.00 

1 ,401-11 ,725 135.00 103.00 71.00 51.00 31 .00 

,726-12,050 119.00 87.00 61.00 41.00 

-2,051-12,375 135.00 103.00 71.00 51.00 

2,376-12,700 119.00 87.00 61.00 

2,701-13,025 135.00 103.00 71.00 

3,026-13,350 119.00 87.00 

3,351-13,675 135.00 103.00 

3,676-14.000 119.00 

4,001-14,325 135.00 



- Statutory maximum allowable fee charge is marginal. No fee will be assessed. 

TE— To allow for higher costs living in Alaska and Hawaii, multiply family income by 
T"to 0.87, respectively, and correlate the lowered income figure with the fee. This 
riation complies with the statutory language mandating that the fee schedule m.ust be 
-sed upon the ability of the family to pay.' A family with 2 or more children enrolled 
all pay one full fee for the first 2 children, and 25 percent of that full fee for each 
ditional child. The above fee schedule anolies to both farm and nonfarm families. A 
mily whose ability to pay has been impaired because of unusual medical and dental 
penses or unusual casualty or theft loss(es) shall be eligible for a reduction on fee 
arge if the amount of unusual expenses exceeds 10 percent of the annual gross family 
come. 

-c.8,86 Stat. 690 (42 U.S.C. 2809 (a) (1)); Sec. 602 (n), 78 Stat.530 (42 U.S.C. 2942 (n)); 
.cgation of Authorities to Secretary of Health, Education, and Welfare, 34 FR 11398) 

Tective date— The regulations in this section shall bo effective April 16, 1973. 
ted April 11, 1973 Caspar W. Weinberger, Secretary 
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CaiLDKtUrS SKKVICl-r. DIVISION 

i:NKC)i.t.:v.:trr r.^iit BIST COPY AVWLABLt 




W PROGRAM: 
fUEAO START-Half Day 
lllCAO START-FulV Day 
I TITLE IV-A-Full Day 
TITLE IV-A-Bef ore/ After School 
I TITLE IV-A-Infant Care 



2. SlTfi 



3. SITE ADDIU:SS 



• CillLD'S NAME 



5, bIRTHDATE 



C. SEX 



. HAS CHILD P?J;VI0U3LY ATT:;:;D2D a HliADGTAJRT or DAY C/J^E 

PROGRAM ? QVES If ycs. Location :^ 

QNO Whon:_ 



7. E-niNIC ORIGIU 

Q Black □ Puerto Rican 

□ liJhitc Dmcx. Ataerican 

□ Oriontr.l □other Latin 
r-i American 

^ Indian 



. PARENT/GUArsDi;i:i l^'iE 



• CHILD LIVES WITII: 

□ Both Mother & 
Father 



Q Hothcr 



10. HOME ADDRESS 



ZIP 



11. uoMK mc::z 



13. HEAD OF 
Q Father 
□ Mother 
Q Guardian 



iOUSEHGLD 



14. F/uMILY IKCW-IE 

TOTAL ANNUAL INCOME 



Number 
in 

Household 



15, SOURCE (S) OF INCOME: 

□ Private En-.ploiTuent U Social Security 

□ Govern5:.ent Eniployir.ent □ Other Benefits 

□ Public Assistance Q Other 



, HOUSEHOLD ME-SriRS; 

NAME 


BinTHDATE 


HIGHEST G?^A'DE 
CO:r?LETED 


EMPLOYED 


17, SLIDING , 
□ ves 

If "/es". 

Amount 

Paid 


Yes 





Mother 












Father 












Children 












Monthly $ 
































OTHERS 

1 























1 declare Uiat the above statements arc true and complete. 



CCNED: 



DATE; 
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DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 

Audit Infonnation Shoot 
Bilingual - Bi cultural Programs 

School Audi tor (s) 

Activity Date 

1. are there any unfilled position? If so, list them below: 
Professional Paraprofessional 



2. Provide the following infonnation for the government-funded teachers: 

Name Bilingual Bi cultural Position Number 
Yes No Yes No 



Page 2 

3. Provide the following infonnation for government-funded aides: 

Name Bilingual BicuUura l 
Yes No Yes No 



4. Are the aides servicing the teachers and students in the bilingual 
program? 

5. Do you have a state-funded community representative for the bilingual 
program? If so, pive his (her) name. 



6. List the names of the board-funded teachers in the bilingual program 
as part of the school's maintenance of effort. 



7. What percentage of instructional materials, non-textual materials, and 
equipment have been ordered? Received? 



8. Are the items mentioned in #8 properly labeled with either of the 
following stamps: 



ACQUIRED through] ^ACQUIRED THROUc;;-) 

; STATE eiL. PROG. ■ ... /TITLE V!l B!L 



BOARD or EDUCATION ' ■ BOARD CF EDUCATIGM 

CITY Of CHICAGO V ■ Cinc.-.CHIC.: /^0; 
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9. List purchase order numbers and dates of requisitions for materials and 
equipment of $100.00 or jnoro that have not been delivered as of the 
audit date. (Oi.iit requisitions that were submitted within 30 days.) 



10. Is there an updated inventory of equipment? 

11. List rooms that have equipment available for classroom use. 

12. Briefly describe the extent of parent involvement at the bilingual center. 



13. How many times has the bilingual advisory council met this year? 
List the dates. 



14. What percentage of the members are parents of the children in the 
bilingual program? 

15. What percentage of the members of the advisory council are bilingual/ 
bi cultural? 



16. List some of the activities in which students in the bilingual center 
are integrated with students in the regular program. 



17. How often do personnel in the bilingual program receive inservice? 



Pa<ie 4 179 

18. Who provides the inservice? 

19. Describe the methods of disseminating information about the bilingual center, 



20 Check schedules of teachers and paraprofessionals. Have copies of these 
schedules been sent to the Division of Special Language Services? 



21. List those instances, if any, in which staff cannot be used in conformity 
with the guidelines. Explain why. 



22 Complete the following enrollment/attendance form for all the teachers, 
qovernn-.ent and bo ard-funded that are in the bilingual progi[am. Refer to 
the teacher 's class list and daily time schedules. Indicate the number 
of children b^inq served daily in each class. Note observed attendance. 



9 



ERIC 



Page 5 



Grade 


Nup.ber 


Teacher's Name 


Daily 
Enrl. 


Class 
Enrl. 


Observed 
Attendance 


Type of 
Half-Day 


Program 
Full -Day 



















































































































































































































23. Principal's Comments: 



24. Auditor's Consents: 



) 



o 
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APPENDIX #8 

DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
PROGRATl AUDIT CHECKLIST 



School Auditor { s ) 

Date 

**************************************** 



I, Staffing 

A. Does staffing at the school coincide with our staffing 
information? _ 

B. List any discrepancies. 



C. List, by activity, any unfilled positions. 



Pi 

Act. # 


^ofessional 
Position 


Pos. # 


Paraprofessi 
Act. fSf 


onal 

Position 











































D. Are teachers charged to the correct position numbers? 
(Verify four teaching position numbers.) 



Activity 


Teacher 


Position # 


1. 






2. 






3. 






4. 







11 MATERIALS, SUPPLIES, EQUIPMENT 

A. What percent of the materials, supplies or equipment have not 
arrived? ^ 
Materials % Supplies % Equipment % 

B. Additional comments: 



C. List purchase order numbers and the date of the requisition 
for all educQtiorial material and equipment that has not been 
delivered as of the audit date. 



Items 


P. 0. 4 


Uato of Roq. 


Amount 
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Program Audit Checklist School 

11. MATERIALS. SUPPLIES, EQUIPMENT (con't) 

0. Comments: 



HI. EQUIPMENT INVENTORY 



A. Is there an updated inventory of equipment? 

B. Spot-check at least four items: 



# Item 


Serial # 


Location 


1. 






2. 






3. 






4. 







C. Additional comments: 



IV TITLE II MATERIALS 

A. Is there an inventory of Title II library materials available? 

B. Are the Title II library materials stamped? 

V. SUPPORTIVE SERVICES (Obtain the following information for the supportive 
services at the school from the principal. If the school does not have 
the activity, place a check in the "Does not apply" box. 

A. Field Experiences : Does not apply 

1. How many trips have been taken? 

2. How many children have been served? 

3. How many trips are scheduled? 

4. How many children will be served? 

5. Additional consents: 



B. Outdoor Education : Does not apply 

1. When did/will the children go to camp? 

2. How many children were/will be served? 

3. Additional coniniGnts: 



C. School -Co:: jnunity Identification : Does not apply 

1. Is there a list of the 35/70 Title I students being served 
by the proqrain? 

2. Are the idontificl students involved in a Title I reading 
activity? 
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Program Audit Checklist 



School 



183 



V. SUPPORTIVC SERVICES (con't) 



3, Briefly describe the school -community representatives' 

daily activity and the amount of time devoted to each activity: 



Activity 


% of Day 



















4. Additional comments: 



D. Health Services : Does not apply 

1. When did/will the health team visit your school? 

2. How many children were/will be served? \ 

3. Additional consents: 



E. Mobile Instructional Laboratories: Does not apply 



1. Fill in the appropriate spaces: 



Type 


Frequency 


Day of Week 


Science 






Lanq. Arts 






Art 1 





2. Additional comments: 



F. Student Eligibility : 

1. Were the children served by the supportive services involved 
in a Title I reading program? 

2. Additional comments: 



t 

B« Comments on Other Supportive Serviceb : 



VI. COMMUNITY INVOLVEMENT 

A. Is there a separate advisory council for government-funded 
programs? 

B. If not, how often are government-funded programs discussed at 
regular council meetings? 

C. When and how frequently does the advisory council meet? 
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Program Audit Checklist 



School 
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VI. COmUNITY INVOLVEMENT 

D. How many members are on the council? 

E. What percent are parents? 

F. Additional comments: 



VII. INSERVICE 



A. What inservice do professional and paraprofessional personnel in 
government-funded programs receive? (Fill in appropriate spaces.) 



Type 


Frequency 


Conducted by 


Local 






Area 






Central Office 






Other 







B. Additional comments: 



VIII. DISSEMINATION 

How is information disseminated about the program? 



A. Newsletters 

B. Brochures (produced by school) 

C. Visits from parents/others 

D. Presentations at community 

meetings 

E. Local nev/spaper releases 

F. Radio and TV 

6. Other (specify) 



IX. PRINCIPAL'S COMMENTS 

A. Are you satisfied with the guidelines of the program operating in 
your school? 



B. Would you like to make any specific suggestions for the modifica- 
tion of any of the programs? 



Program 


Suqqested Modification 















C. Additional comments: 



Yes No Number 
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APPENDIX #9 

Audit - Manaqenont InfQrmation Form 
Key for Recording Audit Exceptions 

Each line is to be used for recordinn audit exceptions for a single activity. 
The first four items (Unit, Visit Number, Date and Auditor) need not be 
repeated on following lines unless there is a change (see attached example). 



Specific Coding Instructions: 

Unit Number - Enter school unit number 

Visit - Enter number of school visit. This can be determined 
from the number of previous visits in the folder. 

Date - Enter date of the audit (mm yy). 

Auditor - If one 'adulter was from field staff; place a "1" 
in the Auditor column. 

Activity - Place the fund number (6 or 7) under the F; place 
the budget activity code in the next two columns. 

For each of the following types of audit exceptions place a "1" in the 
appropriate column if the exception occurred for the specific activity 
listed on the same line: 



Implementation 
Student Selection 



Staff PR if professional 

Vacancies PAR-PR if paraprofessional 

Staff PR if professional 

Use PAR-PR if paraprofessional 



Materials A - not ordered 

B - not received 

C - not stamped or labeled 

D - not available 

E - inappropriate 

F - no invento-y 



Supplies A - not ordered 

B - not received 

C - not star.ped or labeled 

D - not available 

E - inappropriate 

F - no inventory 



Equipment A - not ordered 
B - not received 
C - not stamped or labeled 
D - not available 
E - inappropriate 
F - no inventory 

Enrollment 

Title II Materials A - not available 

B - materia' , not stamped 

Audio* Visual A - not available 
Inventory B - not current 
C - not accurate 

Community A - no advisory council 
Involvement B - inadequate parent involvement 
C - no discussion of GFP 



Inservice - none or inadequate 



BEST COPY AVAILABLE 



BOARD OF EDUCATION CITY OF CHICAGO 



John D. Carsy, President 
Mrs. Carey B. Preston, Vice-President 

Alvin J. Boutte 
Mrs. David Cerda 
Edgar G. Epps 
Bernard Friedman 
Mrs. Louis A. Malis 
Tliomas J. Nayder 
Mrs. William Rohter 
Gerald L. Sbarboro 
Mrs. W. Lydon Wild 



James F. Redmond 
General Superintendent of Schools 

Manford Byrd, Jr. 
Deputy Superintendent of Schools 

James G. Moffat 
Assistant Superintendent of Schools 
Department of Government Funded Programs 



Deep appreciation is expressed to the Chicago 
Community Trust, without whose coopera- 
tion and financial assistance this publication 
would not have been possible. 



BEST COM mm\i 



A GUIDE TO 

PROGRAM 
AUDIT 



DEPARTMENT OF GOVERNMENT FUNDED PROGRAMS 
BOARD OF EDUCATION OF THE CITY OF CHICAGO 



190 



PERMISSION TO n6P«e,0uCE This COPV. 
Righted MATERiM has PtfN GRANTED By 




UNDE* 

STiTUTE OF EDUCAVOS r lOTHtw q£Pflo 
OuCTiON OUTSiOE '"'f t*<if SYsrev RE 
Quires Pt RMiSSiON of ThE COPvRiCi* : 
OWNiEP 



Copyright 1974 by The Board of Education of the Oty of Chicago. 
All rights reserved. 



Printed by Chicago Aligraphy and Lithographing, Co., Chicago, Illinois 




BEST COPY m\Ml 

Department of Government Funded Programs 



PROGRAM AUDIT HANDBOOK COMMITTEE 



James G. Moffat, Assistant Superintendent, Chairman 

Dolores Jahns, Administrator, Program Audit and Proposal Review 
Rosemary Abbate, Staff Assistant Editorial and Communication Services 
Orpen W. Bryan, District Superintendent, District 23 
Helen L. Carry, Principal, Webster Elementary School 
Muriel Clarkston, Staff Assistant, Research ami Evaluation 
Donald K. Cohen, Administrator, Special Programs Development 
Laura R. Crane, Coordinator, Data Analysis, Researdi and Evaluation 
Juan Cruz, Director of Community and Human Relations, Area C 
John Foulkes, Staff Assistant, Program Audit and Proposal Review 
Robert Frank, Administrator, ESEA Title I Language Development Programs 
P. Max Gabbert, Director, Bureau of School Systems, U.S.O.E., Dept of HEW 
Willa Mae Gardner, Chairman, ESEA Title I Advisory Council 
Robert Johnson, Coordinator, State Program Coordinatton 
Bessie F. Lawrence, District Superintendent, District 7 
Leon J. Leibik, Coordinator, Editorial and Communicatton Services 
Marjorie Lerner, Principal, Donoghue Elementary School 
Jordan Levin, Staff Assistant, Research and Evaluation 
Melvin M. Lubershane, Principal, Beethoven Elementary School 
Lloyd J. Mendelson, Director, Bureau of Special Programs 

Jack Mitchell, District Superintendent, District 21 
Siegfried Mueller, Staff Assistant, Research and Evaluation 
Naomi Nickerson, Staff Assistant, Program Audit and Proposal Review 
W. Frank Perry, Director, ESEA Programs, Area A 
Mary Prior, Administrator, ESEA Title I Program Planning 
Michael Quinn, Coordinator, City Program Coordination 
Benjamin Rogers, Staff Assistant, Model Cities Programs 
Karen Roth, Staff Assistant, Editorial and Communication Services 
Fred Schuster, Administrator, Research aiKl Evaluation 
Willism Seabolt, Director, ESEA Programs, Area B 
Velma Thomas, Director, Early Childhood Programs 



BEST COPY AVAILABLE 



CONTENTS 



FOREWORD VII 
PREFACE IX 

1. INTROOUCnON: MONITORING EDUCATIONAL PROGRAMS 1 

Why Monitor 
Who Monitors 
What is Monitored 

Government-Funded Progran^s 

Program Elements 
How to Monitor 

2: THE NATURE OF PROGRAM AUDIT 9 

Scope 

Purpose 

Value 

3. PROGRAM AUDIT IN THE CHICAGO PUBLIC SCHOOLS 17 

Chicago Public Schools 

Department of Government Funded Pro^rjms 

Division of Program Audit 

4. CONDUCTING PROGRAM AUDITS 25 

Types of Program Audits 
Preliminary 
Comprehensive 
Follow-Up 
Special 

Planning the Program Audit System 

Steering Committee 

School Coordination 

Program Inforriation 

Program Audh File 

Program Audit Materials 

Selecting Auditors 

Training Auditors 
Program Audit Procedures 

Assigning Auditors 

Techniques of Auditing 

Auditing Activities 
Audit Exceptions 

5. CONCLUSION 39 



APPENDIX - SAMPLE PROGRAM AUDIT MATERIALS 43 



BEST COPY AVAILABLE 



FOREWORD 



During the past several years, federal and state governments have significant- 
ly increased their support for innovative educational programs. These new 
opportunities have brought with them additional responsibilities for school 
systems, to make certain that the funds are used effectively and properly. 
As a result, educators have needed to develop new techniques for assessing 
the effectiveness of these government-supported programs. 

Monitoring of programs is one technique which can be used by school 
systems to assure government agencies that the programs are being properly 
implemented. The program audit system described in this book is one 
method of monitoring programs. Its use will, I am sure, lead to improved 
educational programs for the children we serve. 

James F. Redmond 
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PREFACE 



This work is the outgrowth of three years' experience by the Department 
of Government Funded Programs in developing and refining a system for 
program audit. As such, it reflects the procedures and practices we 
have developed for use in a large urban school system. 

We have not attempted to present a blueprint for creating a program 
audit system. Rather, each school system must develop its own, tailored 
to fit its particular size, organization, and needs. Instead, we have tried 
to share our ideas, methods, practices, and procedures — drawn from our 
experiences — as a guide to other school systems interested in program 
audit. 

We hope that this book proves helpful to other educators seeking to im- 
prove their educational programs. 

James G. Moffat 
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The purpose of this handtxiok is both \o encourage school administrators 
to establish a program audit system as one means of monitoring their 
educational programs and to provide a worlcing guide to setting up a 
program audit system, based upon the experience of tl^ Chicago public 
schools' Department of Government Funded Programs. 

WHY MONITOR 

The need for monitoring the operation of educational programs is acute. 
Most educators today are aware of the public's increasing concern for 
"educational accountability/' Federal, state, and city governments and 
private foundations are increasing their support for special educational 
programs — and expect an educational, financial, and administrative 
accounting. Educational accountability can be achieved in part by 
monitoring programs continually. 

Another important reason, however, for continually monitoring is that it 
can contribute to the improvement of programs by providing accurate, 
up-to-date facts about many aspects of the programs. The continual 
feedback of information will enable administrators to modify or chance 
programs while they are operating. In short, continual monitoring can 
help solve problems when they are developing. 

WHO MONITORS 

Monitoring can be conducted either by school district staff or by indepen- 
dent monitors. The latter offer demonstrable objectivity, which lends 
credence to their reports. There are commercial enterprises that can pro- 
vide this service, but it is costly and frequently cannot readily supply 
administrators with tue necessary feedback. Funding agencies also have 
generally monitored programs to determine their adherence to regulations, 
but only after the programs have been in operation tor some time. 

In contrast, continual monitoring by school staff members offers both 
cost savings and early information about the program. This internal moni- 
toring can serve to complement the independent, external monitoring of 
program operation, achievement, and finances that a school district is 
either required or desires to conduct. 
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WHAT IS MONITORED 

Ideally, all programs should be monitored In order to improve them so as 
\o provide all students with the best education possible. Certainly, any 
programs that have been developed in measurable terms, with specific 
product and process objectives, are capable of being monitored. 

Government- Funded Programs. At the least, nonlocally funded programs 
supported by federal, state, or city g ^vernment agencies need to be moni- 
tored. Most agencies require some kind of program evaluation and 
auditing. Furthermore, continual monitoring of these programs is one of 
the best ways to ensure that they operate as they were intended, that the 
best possible results are achieved, and that exceptions to agency guidelines 
are corrected early. This last point is particularly important since, if riot 
discovered until the end of the school year, such exceptions to guidelines 
could result in the loss of reimbursement for program expenditures. 

Since this handbook is based on the experiences and practices of the 
Department of Government Funded Programs in conducting government- 
funded program audits, the discussion is limited to these types of programs.' 
However, the procedures and practices presented couM easily be adapted for 
auditing other types of educational programs. 

Program Elements. These special, government-funded programs are devel- 
oped with the support, and according to the regulations and guidelines, 
of federal, state, or city government agencies. In receiving funds for 
these programs, school districts are, in effect, entering into a contractual 
arrangement with the funding agency: in return for financial assistance, 
the school district agrees to implement an educational program approved 
by the funding agency, to achieve certain stated educational results. 

Although different agencies have different mandated requirements - de- 
pending on the Irgislation under which they operate — most require 
similar elements in the proposed educational programs. Of these, the 
following are of concern in program monitoring, since they constitute 
the subjects of audi; and evaluation: 

Performance Objectives - The proposed educational results, 
stated in behavioral terms and subject to measurement 

Procedures and Activities - How the results are to be achieved: 
staff duties, the number of pupils to be served, the length of 
time they are to be served, and the kinds of materials to be used 
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evaluation Design — The method of determining if the procedures 
and activities have attained the objectives 

Staff Development — The means of prjparing program staff to 
carry out the procedures and activities 

Community Involvement — The continuing participation of 
parents and community members in the planning and operation 
of the program 

Expenditures - The uses made of the allocated funds. 

In addition, programs funded by government agencies must supplement the 
educational efforts of the s^ool district They may not replace or supplant 
the district's obligations to each student. 

HOW TO MONITOR 

There are three methods of monitoring these elements of government- 
funded programs: fiscal audit, product and process evaluation, and program 
audit. Each of these is concerned with a specific part of programs; together 
they provide a system of comprehensive, continual monitoring. 

Fiscal audit reviews the propriety of the expenditure of funds allocated 
to the program. Evaluatio.i is concerned with the program's results as 
compared to its projected objectives and with the effectiveness of the 
various procedures and activities of the program design. Both of these are 
well-established and school administrators are no doubt familiar with them. 

Program audit, a relatively new phenomenon, is concerned with system- 
atically comparing program operation with program design. It seeks any 
discrepancies between the design and the implementation of the program, 
it does not judge the quality of effectiveness of any aspect of the program, 
but looks for incipient or developing problems so that they can be solved 
early. 

In the following sections of this book, information on how to develop 
a program audit system is presented: Chapter II describes the scope, pur- 
pose, and value of program audit; Chapter III indicates how and where 
program audit has been developed in the Chicago public schools; and 
Chapter IV presents a detailed method for developing a system of program 
audit 
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SCOPE 

Before an internal prcgram audit system can be developed, its scope and 
limits need to be understood. It is called "program" audit because it con- 
centrates on the programmatic elements. Auditors examine the operation 
of the program to see that the terms of the contract are being met and 
maintained, and that the intentions of the legislation, the regulations and 
guidelines of the funding agency, and the policies and procedures of the 
school district are being followed. 

Program auditors examine the implementation of the procedures and ac- 
tivities that were set forth in the program design. They seek to ascertain if 
teachers and other staff members have been selected, trained, and assigned 
to appropriate activities; if the students have been selected — according to 
the criteria specified in the program design - and assigned to the appro- 
priate classes or activities; if the necessary materials, equipment, and 
supplies have been ordered, received, properly labeled, and put to the 
intended use; if the specified instructional and other activities have been, or 
will be, implemented on time; if the evaluation design is being implemented 
as scheduled; if the proposed staff development program is being conducted; 
if expenditures are being properly classified according to the school dis- 
trict's and the funding agency's accounting procedures; if the parents and 
community are being involved in the program on a continuing basis and 
as stated in the program design; and finally, if the program is supplementary 
to the regular school program. 

Pr ogram auditors do not make value judgments. They do not audit expen- 
ditures, achievement of the stated performance objecthres, nor the nature, 
methods, or quality of the teaching or the instructional activities. Program 
auditors do not recommend changes in the program. Their sole function is 
to :r<entify any discrepancies between program design and program opera- 
t<or., and call th^ to the attention of the staff members responsible for 
op«irating the program. 

PURPOSES 

Program audit has three major purposes. The first is to help pinpoint dif- 
ficulties encountered by program staff members in implementing a program 
design. Since government-funded programs are supplementary, they usually 
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involve special activities and procedures, differing from the regular school 
programs to which the principal and teachers are accustomed. New pro- 
grams particularly are likely to involve unfamiliar or untried procedures* 
Furtt^ ore, conditions affecting the program may have changed in the 
time between designing and implementing it Consequently, difficulties can 
occur in implementation. 

Program auditors help in making the program fully operational by identify- 
ing problems and referring them to the appropriate administrator. By 
this means, early correction can be undertaken and the program can 
function more smoothly and effectively. 

The second purpose of program audit is to make certain that all guidelines 
and regulations are met, and that ail parts of the contract with the funding 
agency are fulfilled. Government-funded programs are subject to several 
kinds of regulation. Federal programs, for instance, are based upon 
legislative acts that place specific obligations and restrictions upon recipients 
of the money* Federal agencies like the Department of Health, Education, 
and Welfare develop regulations and guidelines for programs, based upon 
the legislation. State and city officials often develop interpretations of 
the federal regulations and guidelines. Government-funded programs are 
also subject to the established policies and procedures of the school dis- 
trict's governing body. 

Principals, teachers, and paraprofessional staff may not be familiar with 
all the applicable requirements, regulations, guidelines, policies, proce- 
dures, and rules; consequently, violations could occur. Program audit 
can identify these violations, thus contributing to a more accurate inter- 
pretation of the way in which programs must be implemented to conform 
to the mandate of the funding agency. Program audit, then, should result 
in fewer violations of guidelines. 

The third purpose of program audit is to provide information to program 
planners and administrators which they can use in designing next year's 
program or other similar programs. Implementation problems may be 
caused by deficiencies in the program design; program audit can point 
out these deficiencies early. Since modifications in program design for 
next year must be made well in advance, end-of-year data would not be 
available to program planners and administrators when they need it 

VALUE 

The value of internal program audit is fourfold. It helps narrow the gap 
between intentions and results by providing early detection and correction 
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of problems. It contributes to full and effective use of the allocated re- 
sources - financial, material, and personnel. It ensures adherance to agency 
guidelines and other requirements, thereby avoiding a loss of reimbursement 
of funds as a result of violations identified by the funding agency in its 
own audit Finally, it aids in the impiuvement of the program's design for 
subsequent years. The ultimate value, of course, is that program audit helps 
educators provide students with better educational programs. 
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The Chicago public school system was one of the first in the country to 
develop systematic procedures for monitoring the implementation of 
government-funded programs. In 1971, the Department of Government 
Funded Programs of the Chicago Board of Education established a Division 
of Program Audit, with the responsibility for auditing the programmatic 
elements of government-funded programs. 

The establishment of this division enabled the department to determine 
the degree to which government-funded programs were being implemented 
according to guidelines and program designs, and provided administrators 
with accurate, current information for improving programs. 

The significance of this action can be better appreciated by looking at the 
organization and responsibilities of the Chicago public schools, and par- 
ticularly of the Department of Government Funded Programs. 

CHICAGO PUBUC SCHOOLS 

The Chicago public schools consist of approximately 600 elementary, 
secondary, and special schools, accommodating well over a half-million 
students who are served by over 28,000 teachers with the assistance 
of nearly 17,000 other personnel. As part of the Board of Education's 
policy of decentralization of administrative authority and responsibilities, 
the city is divided into three "areas" and twenty-seven "districts." The 
school system is administered by the "line" officers: principals, district 
superintendents, area associate superintendents, the deputy superintendent, 
and the general superintendent These are the people who operate the 
schools, each one being responsible for decisions at his administrative level. 
The principal is responsible for the implementation of all programs, both 
regular and government-funded, in his school. 

Each administrator has the services of "staff' people, who provide advice, 
technical and planning assistance, and other supportive aid. There are 
staff people at each administrative level. In the central office, the general 
superintendent and the deputy superintendent are assisted by sixteen staff 
departments. Staff personnel do not have direct administrative respon- 
sibility for educational programs; only the line administrators do. 
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The accompanying chart shows the administrative organization of the 
Chicago public schools. 

DEPARTMENT OF GOVERIMMENT FUNDED PROGRAMS 

The great increase in federal and state financial aid to education that t>egan 
in the 1960's led to the establishment by the Chicago Board of Education 
cf the Department of Government Funded Programs. The responsibility 
the department is to provide managerial, financial, and technical service 
to line administrators, particularly principals, in all phases of developing 
and operating government-funded programs. The department's specific 
responsibilities include the following: 

Serving as the contact between all funding agencies and the 
Chicago public schools 

Identifying sources of funding for programs developed by schools 

Providing technical assistance to schools in developing programs 
for potential funding 

Advising schools implementing government-funded programs of 
all requirements, regulations, and guidelines of the funding 
agencies 

Providing financial management service to ensure that funds are 
appropriately and efficiently expended 

Providing managerial service to ensure appropriate implemen- 
tation of programs by schools 

Providing assessment service to government*funded procirams 

Providing for the dissemination of research data and information 
concerning government-funded programs 

Conducting continual program audit to make certain that pro* 
grams nre implemented according to the funding agency's guide* 
lines and the program design. 

These responsibilities are fulfilled by seven bureaus (and their divisions) 
of the department Six of these are program assistance bureaus (e.g.. Early 
Childhood Programs) that provide managerial aid to schools operating or 
developing particular programs. One bureau provides technical aid to all 
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schools requesting it Program audit is conducted by the latter, the Bureau 
of Departnfwntal Program Coordination, which also provides aid in the 
development, financial management, and assessment of government-funded 
programs. 

The department does not develop or operate educational programs. The 
line^staff structure enables the department to avoid auditing its own ac- 
tivities. Consequently, it is able to conduct program audits that are 
internal — within the school system — and yet objective. 

The accompanying chart shows the organization of the Department of 
Government Funded Programs. 

DIVISION OF PROGRAM AUDIT 

Program audit as it was described in the previous section is conducted for 
all government-funded programs in the Chicago public schools by the 
Division of Program Audit. The division's responsibilities include the 
foSloyi/ing: 

Developing program audit methods and procedures 

Coordinating the program audits with the schools 

Devising the necessary instruments (checklists, questionnaires, 
etc.) for auditing programs 

Selecting, training, and scheduling program auditors 
Supervising the actual program audits 

Analyzing the program audit results, noting discrepancies or 
audit exceptions, and reporting these to the appropriate line 
administrator. 

The work of the Division of Program Audit is coordinated with that of 
other bureaus and divisions in the departmer.t: program managers (the 
heads of program assistance bureaus) are regularly informed of audit 
results for the programs they assist; the Division of Research and Evaluation 
uses data collected by the program audits in assessing the degree of achieve- 
ment of the programs* This interchange of information contributes to the 
efforts of the department to assist principals m improving their programs. 



23 



PRCX3RAM AUDITS 



BEST COPY AVAILABll 



The process of conducting program audit involves three stages: a) planning 
and developing a program audit system, including devising instruments and 
selecting and training personnel for auditing; b) establishing procedures 
for auditing, including assigning auditors, preparing for the audit, and 
developing techniques; and c) processing audit exceptions, including 
identifying, reporting, correcting, and checking exceptions. Before exam* 
ining these stages in detail. It will be useful to distinguish the types of 
program audits that can be conducted. 

TYPES OF PROGRAM AUDITS 

Although different school systems operating different kinds of government- 
funded programs will need to determine their own program audit needs, four 
types of audits are likely to occur frequently. The Department of Govern- 
ment Funded Programs has defined them as follows. 

Preliminary. The first type is the preliminary audit. It is conducted during 
the first three weeks of school, when the programs are getting under way. 
Its primary objectives are to determine if the program is properly staffed, if 
the students have been properly selected and enrolled, if the required 
materials, equipment, and supplies have been received or ordered, and if 
instruction has bequii. The preliminary audit is limited to verifying 
that the program has b»en implemented according to the program design 
and funding agency guidelines. It is designed to indicate to the principal 
and program manager any problems that are impeding complete and proper 
implementation. The necessary information can usually be obtained in the 
school office. 

Comprehensive. The second type is the comprehensive program audit It 
involves a reexamination of the elements audited the first time as well as 
personal observation of all program classes. The comprehensive audits are 
begun the fourth week of school. All programmatic elements are audited, 
by observation and by examining records, to determine if the program is 
fully operational and conforms to guidelines. 

Auditors first check to see if any audit exceptions noted at the first visit 
have been corrected. They then examine student records to see if they are 
consistent with the criteria for selection stated in the program design. 
Classroom attendance books are examined to determine the number of 
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students in the program. Materials, equipment, and supplies are checked 
to see if they are available, appropriate, and being used. Teachers' and other 
staff members' records and schedules are examined to determine if they 
are properly assigned and used. Students' schedules are studied, and classes 
observed, to determine if the activities stated in the program design are 
being conducted. Testing records are examined to see if the evaluation 
design is being implemented properly and on schedule. 

Follow-Up. The third type of program audit is the follow-up. Begun in 
midyear, it is conducted selectively. Its purpose is to determine that ex- 
ceptions noted in previous audits have been corrected. Usually, only those 
schools wijch had audit exceptions are visited. The auditors can note 
corrections, can confirm previous findings, or occassionally can detect new 
exceptions. All results are reported and further follow-up audits conducted 
as needed, until all exceptions have been corrected. 

Special. These three types of audits are all that are necessary for most pro- 
grams. However, a fourth type is occassionally required: the special audit. 
This is conducted during a given week to meet a particular need or to 
examine a particular element of a program or programs at all schools. 
Supportive activities such as health services or field trips may be examined, 
or the assignment of personnel may be checked. The^e elements would have 
been checked as part of the comprehensive audit; the special audit, however, 
is an intensive, detailed examination of an isolated element. 

PLAItflUINS THE PROGRAM AUDIT SYSTEM 

Steering Committee. It is particularly helpful to have a committee com- 
prising "staff" people, program administrators, and program teachers, from 
the inception of a program audit system. The steering committee's function 
is to provide advice on the development of procedures and materials for 
conducting program audits, and to aid in the refinement of the system. 

School Coordination. A successful program audit system requires the sup- 
port and cooperation of the principals and program staff. Consequenti/, 
early and continuous communication between the program audit administra- 
tor and the principals and other "line" officers who will be concerned with 
the program audits is essential. This can be accomplished in part through 
the steering committee, which includes some program personnel \ L rtklet, 
or better, a personal letter can be sent to each principeii, explaining the 
purpose of program ai^dit, what they can expect of the auditors, and the 
way in which audit results will be reported to them. Another technique is 
to conduct periodic meetings with program staff, explaining program audit. 
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and soliciting their reactions and suggestions. It is important that prin- 
cipals and program sitaff understand that it is the implementation, not the 
quality, of the program which is being audited. 

Program Inforrriation. The program audit staff needs to gather complete in- 
formation on ail programs: the schools that have programs, the sources of 
funding, the applicable regulations and guidelines of the funding agencies, 
and the program designs. This information can be assembled into an infor- 
mation bank, to which program audit staff can refer in planning the audit 
schedules. 

Program Audit File. Drawing on the program information bank, a file can 
be started for each school having a program. This file would contain a tist 
of all programs in the school and a descriptk>n of each, copies of the 
program design, and copies of all prev'^u;. audit reports. A duplicate 
can be provided to the auditors when they visit the school. 

Program Audit Materials. A variety of information and audit instruments 
may be required by the auditors, depending upon the specifics of a given 
program and the needs of each school system. Five items are likely to 
be needed in most program audit systems: 

General information sheet summarizing all applicable agency 
requirements for a program 

Summary of the program design, indicating staffing, number and 
type of students, required materials, and description of the ac- 
tivities 

instructions to the auditors on procedures 

Program audit checklist, covering all programmatic areas 

Classroom observation form. 

Samples of these materials, developed, field tested, and revised by the 
Division of Program Audit of the Department of Government Funded 
Programs, are included as an appendix. These can be adopted, adapted, 
or adjusted 'o suit the needs of a school district. 

Selecting Auditors. It is usually not feasible to maintain a staff of full- 
time program auditors. Therefore, the most practical approach is to 
use professional "staff" personnel. In Chicago, all teacher certificated 
staff members of the Department of Government Funded Programs 
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serve as program auditors for an average of one-half day a week. Pro- 
fessional personnel of other staff departments can alu> be used. 

Training Auditors, If part-time program auditors are used, the program 
audit staff must develop and conduct a training program. In the Depart- 
ment of Government Funded Programs, inservice meetings for prospective 
auditors are held at the beginning of the year artd during the year as 
needed. At these meetings, the aims of program audit, the information 
sought, and the method of reporting audit findings are discussed. Program 
audit materials are distributed and explained, and the program audit file 
reviewed and its usa explained. The need for familiarity with the guide- 
litvts and the program design, and the importance of the auditor's attitude 
are emphasized. Auditors are reminded that theirs is a service function: 
to obtain information concerning the implementation of the program. It 
is emphasized that they are not to judge the quality of the teaching or 
of any other aspect of the program. 

PROGRAM AUDITING PROCEDURES 

Since different situations will require different procedures, it is not prac- 
tical to attempt to present a universally applicable set of procedures. The 
following items, therefore, represent the practices of the Department of 
Government Funded Programs. They are included as examples and sug- 
gestions. 

Assigning Auditors. For each visit to a school, two auditors are assigned, 
which allows them to compare their observations. Efforts are made to 
pair an experienced auditor with a new one, and a staff member familiar 
with the program and guidelines with a person from an entirely different 
program. Different auditors are sent to a school on subsequent visits to 
provide a verification of previous reports and to increase the objectivity 
of the audit. 

Before going to the school, the auditors review the program audit file, 
the funding agency guidelines and regulations, previous audit reports and, 
most important, the program design, in order to be thoroughly familiar 
with all programmatic requirements. 

Techniques of Auditing. Principals are not notified beforehand of the 
auditors' visit. Therefore, the auditors' first task is to announce their arri- 
val to the principal, advise him of their purpose, and solicit his aid and 
cooperation. They are expected to conduct the audit with courtesy, tact, 
and speed, and to avoid as much as possible disrupting the classes or the 
school routine. 
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The auditors may talk with the principal, the assistant principal, or the 
program coordinator, and with any teachers, teacher aides, other para- 
professionals, or school staff necessary. They examine or spot check any 
re^-^vant records: order forms, daily schedules, students' records, purchase 
orders, or other documents. Inventories of equipment and materials are 
examined and Items sampled for proper labeling. All program classrooms 
are observed. All information is recorded on the appropriate forms. 

Auditing Activities. The precise items to be audited depend upon the type 
of audit being conducted. At some point all of the following activities will 
be performed, using the program audit instruments: 

Staffing is checked to determine whether all positions have been 
filled, all personnel are charged to the correct accounts, and all 
personnel are assigned solely to the duties prescribed in the pro- 
gram design. 

Student records are checked to ensure that the correct number 
of students are enrolled in the proper activities, and th^t stu- 
dents have been selected according to the criteria in the program 
design. 

Test records are examined to determine if the approved evalua- 
tion design is being implemented according to schedule. 

Materials, equipment, and supplies are checked to see that the 
appropriate items have been ordered or received, and properly 
labeled according to the funding agency's requirements, and 
are being used i>olely in the program's activities. 

Expenditure records are checked to ensure that all items are 
properly coded and charged to the correct account. 

Preicivice and inservice activity records are examined to deter- 
mine if the prescribed staff development program is being 
implemented. 

Participation of parents and community members — either infor- 
mally or through community groups - is noted, to determine the 
extent of community involvement. 

All program activities are checked to ensure that they are sup- 
plementary to the regular school program. 
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AUOiT EXCEPTIONS 

Upon the completion of their visit, the auditors prepare their report and 
submit it to the Division of Program Audit. The information is then 
analyzed by the division staff and all audit exceptions noted. These 
will be either discrepancies between the program's design and implemen- 
tation, or viol&tions of funding agency cuiHeliiies and resulaiiuiis^ or 
school district policies and procedures. 

The program audit staff prepare reports on all audit exceptions for each 
program in a school. These reports arc sent to the principal and appro- 
priaff line administrator, who are responsible for correcting the idAntifled 
discrepancies and violations. 

In addition, the reports are sent to the appropriate program assistance 
bureau heads and other staff personnel involved with the program, so that 
they can be aware of the problems and can help the program personnel 
solve them. 

The final step in ths program audit process is the fcMow-up visit of the 
auditors, to make certain that the exceptions have been corrected. The 
result of the program audit process should be a significant reduction in 
audit exceptions during the course of the year. 
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In the three years the Department of Government Funded Programs has 
been conducting program audits, considerable progress has been made both 
in Improving the government-funded programs in the Chicago public schools 
and in refining the process and techniques of program audit. During this 
time, program audit has come to be recognized as a valuable aid to program 
administrators, complementing fiscal audit and peiformance evaluation. 
Together, these methods of monitoring have provided a comprehensive, 
detailed analysis of how a program is progressing. 

The foregoing discussion has been based upon the experience gained in 
auditing government-funded programs in one of the largest schooS systems 
in the nation. Inevitably, it reflects some of the probleris and policies 
particular to this situation. 

Recognizing that other school districts will have very different problems 
and policies, no attempt was made to present a complete, step*by-step 
design for creating a program audit system. Instead, the lessons of the 
last three years have been used as the basis for a working guide to pro^iram 
audit, in the belief that these considerations, suggestions, anH ideas would 
be most useful to others. 
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GENERAL IIUFORMATIOlU SH£ET 



READING: TOP PRIORITY 
ESEA Title I 
Fiscal 1974 



Allocation and Use of Funds 

No less than 70 percent of the funds allocated to a school may be expended for 
instructional activities listed under programs I, 11, and IV. 

No more than 30 percent of the funds may be expended for supportive services 
activities listed under Program III. 

Only those pupils who are participants in an instructional activity may receive 
supportive services. 

Expenditures for each pupil participant should be between $500 and $700. 

In the event that ail funds allocated to a local school are not expended, the funds 
will be used in the 1 974 Title I summer programs. 

Activity Selection 

The local school selects, purchases, and implements the activities which best 
meet the needs of its pupils. 

Title I personnel of the school are determined by the ESEA Title I activities se- 
lected. The number of teachers and teacher aides depends upon the activity 
selected. Example: only the selection of Activity 032— School-Community Identi- 
fication provides a school-community representative. 

The number identifying each activity is also the budget number of the activity. 
The number appears on each information sheet just before the title of the activity. 
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The attached Activity Information Sheets have been prepared to assist Tetie I 
schools by providing information about each specific activity offered for local 
selection. 

Compatibility 

It is recommended that schools select reading activities having instruction ma- 
terials con;patible w^th the local school basal reading materials. 

Supplementary Aid 

Title I activities must supplement, not supplant. Board of Education services or 
instruction materials at the local school. 

Pupil Selection 

Categorical Aid. In no instance may all pupils at a given g^ade level in a school 
be served by Title I activities. 

Criteria for pupil selection are specified in each activity's description in Read- 
ing: Top Priority, Fiscal 1974. 

Eligible nonpublic school pupils participate in the activities under conditions 
stipulated by federal and state guidelines. 

instructional Time 

Participating pupils receive daily instruction in the activity. (See specific 
activity narrative.) 

Teachers and teacher aides devote full time to the activity to which they are 
assigned. 

Coordinator, fii school having at least five Title I teachers may use the ser- 
vices of a Title I teacher assigned to a small group or tutorial reading activity 
for one daily period to coordinate all Title I activities. (See specific activity 
narrative.) 
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Instruction Materials, Supplies, and Equipment 

Instruction materials. Only materials specific to the activity may be ordered 
and used. 

Supplies ordered for the activity should reflect in quantity and kind the num* 
ber of pupils enrolled and the instructional focus of the activity. 

Equipment provided for the activity must be readily identifiable as ESEA 
Title I equipment, used with Title i activities, maintained under reasonable 
security measures, and inventoried on an up-to-date basis in each participat- 
ing school. 

In order to retain the equipment and furniture provided by an activity, a 
school must elect to continue the activity. The equipment and furniture issued 
to a school not continuing the activity will be transferred to a participating 
school. 

Orders. Instructions for ordering materials, or equipment required in an ac- 
tivity will be sent to participating schools. 

Evaluation 

Evaluation is mandatory in ail Title I activities. The evaluation design is included 
at the end of each activity narrative. Information concerning evaluation proce- 
dures will be sent to the participating schools by the Division of Research and 
Evaluation. 

Selection Guide Changes 

Requests for change of an activity once entered and approved on a planning guide 
will not be honored; therefore, initial selection should be carefully considered. 
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SUMMARY OF PROGRAM DESIGN 







ESEA TITLE 1: ACTIVITY INFORMATION SHEET 






Program 1: Developmental and Remedial Reading 






Activity 025: Individualized Instruction for Continuous Development Space and 
Facilitv Reouirements 






K — One classroom (if available). 
PI -6 — One classroom. 






Staffing 






1 teacher 

1 teacher aide to serve each self-contained class on an equal basis. 






Pupils 






This activity must serve pupils on a categorical basis. In no instance may all 
pupils at a given grade level be served by a Title 1 activity. 






The 60 most educationally deprived kindergarten pupils are selected as partici- 
pants according to activity criteria. 






The 31 most educationally deprived P1*Pz pupils and the 34 most educationally 
deprived IR*grade 6 pupils are selected as participants according to activity 
criteria. 
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instruction Materials and Supplies 

Kindergarten — Title I provides a locally selected structured program which uses 
a specific approach or system to develop readiness skills. 

p^. 5 —Title I provides supplementary instruction materials. 

Supplies may be ordered only for use in this activity and must reflect in quantity 
and kind the number of participating pupils and the instructional focus of the 
activity. 



Activity Description 

Kindergarten (for every 60 pupils) — One Title I teacher and one teacher aide are 
provided. Approximately 30 pupiSs attend the morning session; the others attend 
the afternoon session. Each group of 30 is divided into two self-contained classes, 
one taught by the board-funded teacher and one by the Title I teacher. 

Pl-Pz (for each group of 31 pupils) and eR-6 (for each group of 34 pupils) 
One Title I teacher and one teacher aide are provided. Each group is divided 
into two self-contained classes, one taught by the board-funded teacher and one 
by the Title I teacher. Teachers are responsible for instruction in all areas of the 
curriculum and emphasize instruction in reading. * 



A complete description of this activity 
Reading: Top Priority Fiscal 1974. 

Co.-;t per pupil K — $654 

P i -6 - $649 



appears in the activity narrative in 

Unit cost K - $20,940 

PI -6 - $20,780 
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INSTRUCTIONS TO AUDITORS 



1 . This folder includes: 

a. A copy of Instructions to Auditors 

b. A copy of the Audit Information Sheet 

c. Funding information 

d. A bulletin on testing with a copy of the test order form 

e. A list of activity numbers assigned to ESEA Fund 7 programs for the 
1973-74 fiscal year 

f. A copy of a personnel bulletin concerning changes in position numbers. 

Prior to your visit, please review the information in this folder, as well as the 
guidelines for the activities in the schools you will be auditing. 

2. Check the master folders for the schools you will be visiting. They will cor;- 
tain information concerning programs and staffing. You may take the folders with 
you, but please return them the same day. 

3. As staff personnel, it is our responsibility to establish rapport with the prin- 
cipals and clerks at the schools we are auditing. We are in-house personnel who 
have come to offer assistance. Our purpose in being at the school so early is to 
serve as resource personnel to help funded programs get started smoothly and 
with as much cooperation as possible between our department and the schools. 

4. When you arrive at the school, check the staffing of both professional and 
paraprofessional government-funded positions. Actually look at the time sheets. 
Staffing at the school should coincide with the information in the master folder. 

Note any discrepancies and list the position numbers for any unfilled professional 
positions. List all unfilled paraprofessional positions. Government-funded ESEA 
professfonal positions carry position numbers in the 33,000 through 35,000 
series. Model Cities position numbers are in the 16,000 series. All other govern- 
ment-funded positions are in the 36,000 series. 
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5. Check to see whether tests have been ordered. If the order has not already 
been submitted, ask the clerk to forward it immediately. 

6. Check to see whether the list of pupils participating in government-funded 
programs has been submitted to the Division of Research and Evaluation. If not 
ask that it be forwarded immediately. 

7. Remmd the clerk that orders for supplies and materiais are due September 
17. Advise her to keep a specirJ file for government- funded orders. As materials 
arrive, they should be checked against the order and stamped with the proper 
stamp. The packing slip is to be stamped properly, signed by the principal, and 
returned immediately. Since most orders are submitted in June, check to see 
wrich materials have not arrived, and check to see whether invoices have been 
returned. 

8. Find out whether the proper stamps are available in the schools. 

9. Teachers in government-funded positions carry the government-funded posi- 
tion number. This simplifies the control of position number^ at the school. System 
seniority policies apply to teachers in government-funded positions as well as to 
those in board-funded positions. Clarify this if there is any misunderstanding. 
Explain that when a regular teacher is in a government-funded position but car- 
ries a board-funded number, board funds pay the higher priced teacher and gov- 
ernment funds pay the substitute. A great deal of money will be saved by the 
Board of Education if proper position numbers are assigned to teachers. Instruc- 
tions for changing a teacher's position number are included in the second section 
of this handbook. 

If you have any questions, please call the Division of Program Audit, extension 
4507. Also, any suggestions you may have will be most welcome. 

Please return the completed Audit Information Sheet to the Division of Program 
Audit. 
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PROGRAM AUDIT CHECKUST 



School Auditors 

Date 



I. STAFFING 

A. Does staffing at the school coincide with our staffing information? 



B. List any discrepancies. 



C. List, by activity* any unfilled positions. 



Act. # 


Professional 
Positiotk 




Paraprol 
Act* # 


Fostional 
Position 

































D. Are teachers charged to the correct position numbers? (Verify four teach- 
iing position numbers.) 



Activity 


Teacher 


Position # 


1. 






2. 






3. 






4. 
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II. MATERIALS. SUPPLIES. EQUIPMENT 

A. What percentages of the materials* supplies, and equipment have not 
arrived? 

Materials % Supplies % Equipment % 



B. List purchase order numbers and the date ot the requisition for all edu* 
cational material and equipment that have not been delivered as of the 
audit date. 



Items 


P.O. # 


Date of Req. 


Amount 



































C. Is there an updated inventory of equipment? 

D. Check at least four items. 





Item 


Serial # 


Location 


1. 








2. 








3. 








4. 









E. Comments: 



III. TITLE II MATERIALS 

A. Is there an inventory of Title II library materials available? 

B. Are the Title II library materials stamped? 
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IV. SUPPORTIVE SERVICES 

(Obtain the following infornnation for the supportive services at the school 
from the principal. If the school does not have the activity, place a check in 
the "Does not apply'' column.) 



A. Field Experienc es 

1 . How many trips have been taken? 



ONA 



2. How many children have been served? 

3. How many trips are scheduled? 



4. How many children will be served? 

B. Outdoor Education 

1 . When did/will the children go to camp? - 

2. How many children were/will be served? 



C School-Community Identification 

1 . Is thert/ a list of the 35/70 Title I students being served by 
the program? 



2. Are the identified students involved in a Title I reading 
activity? — — . 

3. Briefly describe the school-community representative's daily 
activity and the amount of time devoted to each activity: 



Activity 



% of Day 



D. Health Services 

1. When did/will the health team visit your school? 

2. How many children were/will be served? 
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E. Mobile Instructional Laboratories: DNA 



1 . Fill in the appropriate spaces: 



Type 


Frequency 


Day of Week 


Science 






Lang. Arts 






Art 







F. Student Eligibility: 

Were the children served by the supportive services involved in a Title I 
reading program? 

G. Comments on Supportive Services: 



V. COMMUNITY INVOLVEMENT 

A. is there a separate advisory council for government-funded programs? 

B. If not, how often are government-funded programs discussed at regular 
council meetings? 

C. When and how frequently does the advisory council meet? 

D. How many members are on the council? 

E. What percentage is parents? 

F. Comments: 
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VI. STAFF DEVELOPMENT 

A. What inservice traininq do professional and paraprofessional perso:inel 
in government-fundeo programs receive? 



Typa 


Frequency 


Conducted by 


Local 






Area 






Centra! Office 






Other 







B. Comments: 



VII. DISSEMINATION 

How is information disseminated about the program? Number 

A. Newsletters 

B. Brochures produced by school 

C. Visits from parents or others 

D. Presentations at community meetings 

E. Local newspaper releases 

F. Radio and TV 

G. Other (specify) 

VIII. PRINCIPAL'S COMMENTS 



A. Are you satisfied with the guidelines of the program operating in your 
school? 
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B. Would you like to make any specific suggestions for the modification of 
any of the programs? 



Program 


Suggested Modification 















C. Additional comments: 
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CLASSROOM OBSERVATION FORM 



The Classroom Observation Form has been designed as a one-page verification 
of program conformance to the guidelines described in the proposal. This infor- 
mation will be — 

The basis for reporting audit discrepancies to the associate superintendents 

computerized to allow for immediate retrieval and ut j in evaluating the 
programs 

disseminated immediately to the appropriate program administrators 
the basis for foliow-up audits. 



The following instructions indicate how to complete the Classroom Observation 
Form. 



Item 


Instructions 


Activity Number 


List the program activities, repeating the activity 
number for each classroom* both locally and gov- 
ernment-funded, having the activity. For locally 
funded classrooms, add "L"' after the activity num- 
ber. 


Room Number 


List t d room number for each classroom. 


Grades 


List all grades taught in each classroom. 




o 
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Item 


Instructions 


Enroiiment 


Check the class enrollment book of each classroom 
to deter:nine the number of students enrolled in the 
class. If the activity serves a large number of stu- 

Hon^e in cffnollor amiinc rocorH tho total numbfir of 

Students enrolled in the program in the Daily En- 
rollment space and the students enrolled in the 
period during which the audit is being made in the 

Olflce Pnrollmont cnaCA If thfi fiCtivitV SOrVOS a Self* 

contained classroom, place a dash in the Daily En- 
rollment space and the class enrollment in the Class 
cnruiiiTicnx apsco. 


Observed 
Attendance 


Count the number of children in the room at the 
time of the audit and record that number in the ob- 
servea axienuance cQiumn. 


Pupil Selection 


Check the records of two pupils in each class to de* 
termine whether they meet eligibility guidelines. 

wSe yes or no in apace CA|JIciiii uiS'wioijciiiwico. 


Staffing Vacancies 


Place a check after the appropriate item if there is 
a vacancy of Teacher, Teacher Aide, or Other staff. 


Use 


Write "Yes" if the use of staff conforms to guide- 
lines, "No" if it does not. Explain any negative en- 
tries. 


Instruction Materials 
Available 


Write "Yes" if the instruction materials for the pro- 
gram are available in the classroom, "No" if they 
are not. 


Stamped 


Write "Yes" if the materials are properly stamped, 
"No" if they are not. 
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Item 


Instructions 


Appropriate 


Write "Yes" if the available materials are those 
designated for the program. "No" if they are not. 
Explain any negative entries. 


Supplies 


Write "Yes" if supplies are available in the class* 
roomr "No" if they are not. 


Equipment 
Avaliable 


Write "Yes" if the necessary equipment is available 
in the classroom, "No" if it is not. 


Labeled 


Write "Yes" if the equipment has been properly 
labeled, "No" if it has not. 



j 
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CLASSROOM OBSERVATION FORM 

School Date— 



Audit Item 


Classes Observed 


Actiuitv NumhAr 


















Room Number 


















Grades 


















Enrollment ^. ^ 

Class 


































Pupil Selection ^ 


































^. Teacher 
Staffing 

Vacancies Teacher Aide 

Other 


















































Staffing Use 


















, ^ ^. Available 
Instruction ^ . 
Materials Stamped 
Appropriate 


















































Supplies Available 


















c ^ Available 
Equipment 



































Do the activities appear to supplement rather than supplant local effort? 



If not, please explain. 



Do the activities appear to be operating according to guidelines? 



Explain any discrepancies. 



Additional comments. — 
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A DDE N DUNt TO PROGRRfS^iSKtlPH^ftSftloOK 



Chapter VII - "Data Collection Subcommittee" - describes a computerized 
data bank model which has been developed for classifying, collecting, and analyz- 
ing data gathered from visitinq schools implementing government funded programs 
to determine the degree of compliance of the operational program with the proposal 
as submitted to the funding agency. The form to be used in collecting this data 
during field audits is shown in Appendix fr*8 and the key for recording is shown in 
Appendix ^9 of the report. 

All audit exceptions collected from school visitations for the school years 
1971-72. ,1972-73, and 197i-74 have been transcribed from manual records to tape 
input for processing through the Board of Education computer facility. At this 
time the data processing program is being debugged prior to the processing and 
analyzing of the data for the three school years. Although it is difficult to provide 
a specific date for the completion of th:s task because of problems relating to the 
debugging of the program and obtaining priority computer time, the data are avail- 
able \n their initial form and can be used in the interim for the assessment process. 

Attached to this addendum are the following: 

1. Flow chart describing the preliminary systems design used for 
processing audit data (Attachment #1) 

2. Print-out indicating the program descriptions for each of the 
three years (Attachment >IZ) 

3. Print-out listing by code the audit exceptions noted in specific 
school units for particular activities (Attachment rS). 

Evaluative instruments have been developed to assess the effectiveness 
of the Guido to Proiiram Audit . While the first instrument 'Attachment ?*4) 
will measure the frequency ol the guide's use and assess the effectiveness with 
which iho guide did or did not provide solutions to an immediate problem, the 
second questionnaire (Attachment «5) will attempt to assess the long range impact 
of the guide. 

The results of these two methods of evaluation will be helpful for 
determining whether or not the guide should be modified on an annual basis. 
Inasmuch as the guide has been distributed near the conclusion of the 1973-74 
school year, its total impact cannot be reflected until the 1974-75 audit data arc 
analyzed. It is anticipated that this analysis %vould be completed during the summei 
of 1975. 
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Department of Government Funded Programs 
Computerized Audit System 




TRANSACT! CWS 



EDIT UNfiT, 
VISIT NO., 
ACTlVJTV 



IMAGE 



COtsJTR£uCARp 



TABi-CS 



CORRECT 



RAW 
rRAN^SACTlCNS 




0 



VARiAr^te- 
Kev sort- 

SpeClFIE^C* AT 
TlMC OF Rte<a 




CohnROL Card 

spec/ FVlfVG- 



SPSS HUHS 
ST'ECiAZ. Rg:q. 



Print svfA. 
Rcpr. OF 



CF AUDIT 



. ■ n .- i -^;...^^.-^^ Attachment *2 
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1 
2 
3 

5 
6 
7 
8 
9 
XO 
II 
12 
13 

15 

16 

17 

18 

19 

2C 

21 

22 

23 

24 

25 

26 

27 

26 

29 

3C 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

5C 



99eFUN0 SIX» 
999FUND SEV£^' 
6016">16')10'^1EMEkGENCY 
6026<-'2 0';2PRACTICAL 



ACTIVITY NCI SPECIFIED 

ACTIVITY MOT SPtCIFIEO 
ENPLOYMEMT PRQGRAf-' - SECTICN 
MtRSE TRAINING PROGRAM 



6')36036^.3s:i.5NEIGHRCRHCaD YOUTH CORP _ _ _„ 

6C-46U4 0;,'»yANPOV<£l^ BASIC LIT. PROJECT 
6056056J50vStr^ERGENCY ENPLOYMEMT PROGRAM - SECTICN 6 



6:-^ 66 '6 
60 7607 
608608 
609609 
610610 
611 



CC6N0EA - TITLF 
Cv.7J0B CORPS 



III 



'j:'3PArjpcweR clerk typist training program 

0v9PRe-APPtlfcNTICE TOOL AND DIE MAKING PRCGRAM 
CICNEDICAL LAo.CRATORY ASSISTANT PRCGRA^' IE 
OllPRt-APPRfcraiCe N.ETAL WORKING 

612 mPRE-APPRE!iTJCE N'ETAL WORKING 

613 U12PAC& - BASIC VUC. AND PRE-VCC, TRAIN. 

614 013LICENSEi) PRACTICAL NURSE TRAINING PRCGRAM 

615 Ol^yEOICAL LABCRATnRY ASSISTANT 

616 015CLEKK TYPIST (P-T) 

617 617O160ASIC ED. AND PRE-VOC. TRAIN. PRCG. II 

6186ieG17WIN - EEA WELFARE 01^. PROGRAM SECTION 9 

619 018CRUG PREVENT IG.\ A;^0 CARR. PROGRAM . . . 

623 G19CRUG EC. SEMINAR FOR PRIN. CF ELEM. SQU. 

621 02;WIN - CLERICAL SKILLS I . 

622 021PSYCHOLINGCISTICS ;>n. SERIES EVAL. 

624 022MANPDWER CLERICAL SKILLS 

625625625J23AREA GIFTEC SERVICE CENTERS TRAINING PRCGRAM 
616616:2^EAPLY ACTION OP^ORTUNI TY CENTERS 
612 LllPRE-APPRENTICE METAL WORKING 

626 j25GIFT MtSEOLCGY PROGRAM . 

628628628:26GIFTEC RE lyBURSEMENT PROGRAM 



629 C3XCHILC CEVEL. - 
63J63D63-- j28FnLLOW THRCLGH 
63X631631')2&FQLLCW THROUGH 
632632632o2eF0LL0W TFROUGH 
6336?3633^.2arOLLrW THRCLGH 
63463A634: 2HFnL LEW THRClGH 
635635635326FCLLCW TFRCLGH 
636636 •.;28F0LLCW THROUGH 
637637637C26F0LLCW 



H.S. MED/OEN 

- CENTRAL OFFICE 



OGOEN 
PRICE 
- CHILD 



DEVELOPMENT 



THRCLGH - 

63B638638t.3 .PRE-K INOERGARTEN 

639 w'31CHILr CEVEL. - H.S. MuD/DEN _. 

640t436A':\;32ACMINISTRATI0N (MODEL CITIES) 
641 C33NEW CAREERS (CC-PLUS) 

642642642^34 1-'iSFRUCTICNAL (T«^AM CO-PLUS) OAKENWALD 
643 035C0MM^NITY SCHOOLS (CO-PLUS) 

644 036CENTFRS FOR ACCrLERATiNG LEARNING 

645 C37MQCEL CITIES - CO-PLUS HEALTH SERVICES 
646646 OS^NUTt^ITIUKAL ANC HEALTH SERVICES (CC-PLLS) 
64 76476470 3<iPRE-SCFCCL (CO-PLUS) 

648 IN-SCRVICE PROJECT (CC-PLUS) 
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51 CAIIN-SERVICE TRAINIUG PRGC^AM 

52 639639031ChILC CEVEL. - H.S. MED/DEN 

53 62irA3INC* EL. ANC SEC. AUT. ACT. 

5A 651t51651C4^^TPSL AT SENN 

55 652652602C A5PEAL:I.NG CEMER AT HESS UGC . - - - 

56 653653 CA6FREE BREAKFAST PROGRAM 

57 65<t 0A7LANCUACE ARTS - BETHLNCt ^'A^LEY UGC 

58 655655CA8LANGUAGE ARTS - BETHUNE 

59 656656CA9IMSTRtCTinNAL TEAM - OVERTCN 

6U 657657 OS^PERFCRKA^JCE CONTRACT - READING PRCJECT 

61 658 '^51SU*'MEP. CC-fLLS PROGRAM — 

62 659 051SUVMER CC-PLUS PROGRAM 

63 66066:052 riSTPLCTlOriAL TEAf - HERZL 

64 661661053CLASSRnn.V AIDES - JOHNSON 

65 662662^:54INSTf<UCTI0NAL TEAM - TESLA 

66 663663055 lr>:STRUCTIC.\AL TEAM - ViCODSCN SO. 

67 66466A-:5fclNSTRUCTinNAL TEAM - STOCKTON 

68 665 C57EPDA PART B-2 

69 66666666feJ5^PRINCIPALSHIP INTERNSHIP 

70 667667667C59>'IGHT TO REAC 

71 668668 C'6:.PRE-/iPPRENT ICE TOOL ANC DIE MAKING 

72 669669 C61VA HCSP. - V^ESTSIOE - Mfco. LAP. ASSIST. 

73 670 ce2PERSGNNEL SERVING ANC STAFF PROGRAM 

Jit 671I»63JUAN MCkEL CAMPOS DISS. PROJECT 

75 673 .>6AEPCA - AREA B 

76 67A065ALL CITY THEATRICAL TROUPE 

77 6750e6CHlCAG0 COMMISSION TRUST AWARD PRCGRAM AUDIT 

78 65A65A:67LANGUAGE ARTS - MANLEY LGC 

79 658 CfcennME-VISlTING READING TEAM 

- - 80 ■ 67C^69C0r'PLTER BASED GUID.^^XE PROGRAM 

ei 677 07;MrRE EFFECTIVE SCHCCL PERSONNEL UTILIZATION . 

82 682 n71PUBLIC ECUCATION RRANCH FACILITIES 

83 6836e3C72SU'MER SisI^r-'INO POUL» nEt>ARTMF\T CF LA8CR 

84 68A C73SU^'MER S'^IMMING PCCL , MGOEL CITIES 

95 685 u7AeETTtR PCYS FQUriP. - SEARS Ar4D FARRAGUT OUTPOST . . 

86 686t.e6686u73ClST. 19 - fcILI,GLAL TCACHER CCRP 

87 687 .;76FAf.ILY LIF= EOUCATICN 

88 688 J77PELL ELEM. PILOT PROJECT FOR HAND. CHILD. 

89 6896896n9J7RCAP.tER COPCRTUNPY PROGRAM 

90 69069069 JC;79CUSAPLE EXEMP. PROGRAM 

91 691 Ca'-CE*^'. IN CE'Vr FOUCATICN 

92 " 692 J81SPGCIAL ECLCATIGN PLANNING - GRANT 

93 693693693;a2CC0P. VHCATICNAL PROG. FOR PHYS. HAND. 

9A 69A69A69A:83EXP. SCH. WORK EXP. AND CAREER EXP. PRCG. 

95 696696 CEASAFE STREETS ACT 

I'j ^9%'''''''c1AiE^^ER^l™^^^ - sears and FARRAGUT CUTPCSTS . 

• 9fl 685 CTAL'ETTER BOYS fOUX. - SfARS AND FARRAGUT CUTPCSTS 

99 692 t2SSHECIAL ED. SERVICES CCNT. PRCJ. (S£R. CEAF) 

ICU 68ft083EX. SCH. WRK. EXP. AND CAR. EXP. PRCG. - STURGIS EVGC 
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69»027SnurhVNt$T EC. LAP. GRANT PRCIG. 
701 C:42ADf'IMSTSATlCN TITLE III 

7r27C27C2G86LT. INN. MEC. F0« PUP. WITH CONM. CIS. 
7n^7*l3703J87AN'EK. CULT. ANC ED. SKILLS AND CRB. IND. V!L« CENT. 

7Q47r.4 OeeAREA A IMSERVICE ED. AND MEN. HEALTH PRC. 

7C57C57*>5'-e<;C0MVUNITY BILINGUAL CENTERS 

7067;67 )6^S . EAST V^CDCLAV^N ACADEMY ... - 

7O7707O91CP6?.ATICN IMPACT 
70a7t'B708092PRE-ALGED'^A DEVELOPMENT CENTERS 
709 G93RES. PKO. FCR EMOTION. DISTURBED CHIL. 

71o71071.)C.94flREA H.5. PREP CENTERS 

711 .J95EXPER. SCHCCLS PLAN. GRANT 

712712712C96CESIGNING SIM. MOD. FOR ED. EXTENSION 

713713w97A MULTI-GRAI.E HELPING KELAFICNSHIP 

71<»71-714;;99C0MPUTE;<-aSSISTEC Ii:STRUCTlCN 

715715715-99SPECIAL PRC. IM READING AND LAN. 

71fc7l6716i:.,fiASIC CCCUP. AND SKILL TRAIN. CENTER 

7ia7l8?191'.2FlELn EXPERIENCES 

7197ig71'il'.-3PRGGRA,vvnC PEACTJG INSTRLCTICN 

72:72'j72::1C4SKILLS TO FELP ACC READ. PROGRESS 



PRCC. TC UPGRADE 



READ. 
LEVELS 



7217217211u5SPECIAL 

7227227221i:6PtAClNG SYSTEMS FCR PRI 

723723723i:7|-ORIZCNS AhEAC . 

724724 183UR£AN AND RURAL SCHOOLS IICD 
7257257251C9I.V1C. INST. IN COAT 
7<.i7JlU.9FCMteASE 

70470411JCL0SriG THE INTER. ACHIEVEMENT GAP 
711711111ED. THEi^APY THRUUGH PERFORM. INST. 
726 ie4U £ R SCFC IS - CRRI 

727727727113CUTCC0R ECUCATION AND CAMPING 

728 114SCCIAL ADJUSTMENT CENTER 

729 C2eFGLLCW-THRQLGH 
73':73073rilbPILINGLAL CENTirrtS TITLE VII 
731 C23FCLLCVN-THRCUGI- 

7327327321l6SChOrL CGMV. IDcNTIF ICATION 



733 
734 

735735 

736 

737 

738 

739 

740740 
741 

742742 
743743 
744 



CZaFULLCW-THRGLGH 
.*23FCLLCl^-THRCUGH 
ifa5U L R SCFCCLS-SPECIAL 
C29FCLLCVv-ThkaUGH 
C28FOLLCW-ThROUGH 
028FOLLCV«-THRCUGH 
186U L R SCFCCLS 
IPTU L R SCHOOLS 
leeU £ R SCHOOLS 
ie9U L R SCICCLS 

19:U L R scfocls 

LCARN. 



117E^RLY 
745745745liriCMILC-PA<ENT CENTER 
746746746119FAfMLY LIVING CFNFER 

74774712:CEVEL0P. APPROACH TO READ. 



PROG. IN READ. AND LAN* 



SKILLS TO HELP ACC, PEAC. PRCG. 
SPrCIAL PROG. TC UPGRADE READ. 
READING SYSTEMS fC^ PRI. SChCCLS 
CUrnCGK ED. AND CAfP. 
FIELD EXPERIENCES 
CENT. - EXT. DAY KINDER. 
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151 7A874a7A8l21l-tALTH SIrRVICES 

152 7497^9122PHL;f:fcTlC APP. TO REMEO. J^EAO. 

153 75C753123Pai<ALLCLISTIC RCAOING P.^QG. 

154 75175112^IMP. REAU. ACH. THROUGH TFACH. TVPEWRITING 

155 752752125LtARN. SYS. TflR TOT. INU. CF MATH/READ . 

156 75375375312fcfCH. INST. LABC^ATORIES 

157 75475<il27ThE LEARNING GAME . . 

158 755755126IND. N'ATh INST. 

159 756756756129T6SL ON WHEELS 

160 757757 12:CLl'STER CLCSEC-C IRCt I T TcLeVlSICN 

16L 753758131GUIDA\CE FCR TITLE I ELE*^. SCH. PLP. 

162 759759132f ICfU]TEACH. APP. TC TEACHER ED. 

163 76u76n33STAFF CEVEL. FCi^ TITLE I TEACHERS 
16A 761761 13^TITLE 1 LEAC TEACHERS 

165 762762125RESEARCH AND FVALUATION 

166 763763136PUFLIC INFOnNATICN CENTER 

167 76476A764137ACVINSITRATIC\ - TITLE I _ 

168 7657fc5765138INSTRtCTlCNAL TcA.V SCHCOLS 

169 ibb 139INST. LANGUAGE OEVEL. 

170 767 191U £ R - PHONETIC APP. TC READ 

171 768 128U C R - STAFF CEyEL. FCR TITLE I TEACHERS 

172 769 128U t R - STAFF CEVEL. FCR TITLE I TEACHERS 

173 77.j7707701A ANGEL GUARDIAM ORPHANAGE . 

174 771 iHlLYOIA CHILDF«ENS« HOVE 

175 772772772142ST. JOSEPH CARAMC3LIT . 

176 773773773143HCUSE CF THE GQDO SHEPHERD 

177 77477477414ACHICAGC PARENTAL-BOYS 

178 775775775145CHICAGC PARbNTAL-GIRLS 

179 728728114FANILY GUICANCE CENTERS, 

180 737737n28FCLLCVs-THRCLGH 

181 77677677fcl^7MA?.Y BflRTELKE HOME . 

182 77777777714BNISSICN CF ( LR LADY OF NERCY 

183 778 149LAWKENCE HALL /RANDALL HOUSE ... 
18A 77977977915. liHL ICH CHILDREN HOME 

185 781781151CHAPIN HALL . 

186 7827827S2152ST. MARY CF PRCVIDEr.CE 

137 783 192U £ P - MCPCTEftCH. APP. TO TEACHER ED. 

188 784784153SW REGIONAL LABORATORY KINDER. PRCG. 

189 7857P.57a5154TEST AND LIBRARY BOCKS 

19c 786786786155INSTRLICTI0NAL A.MD A-V MATERIALS 

191 7877877871b6ACyiNlSTRATIVE - TITLE II 

192 7887B3783157A-V COOPERATIVE GRANT 

193 7897897a91'3eSUV'''ER READING PROGRAM 

194 790 159CIAG:jOSIS Af.C CONSULT. FOR DEAF £ BLIND 

195 792 'w28F0LLrv>-THRCLGH 

196 79379316-PA?.. AND INF. FO. FOR VISION t HEAR. HANOI. 

197 79A79A16lfCLA«£N, JACKSCNt KOSCILSKC, SEwARD RILIKGUAL CENTER 

198 795795795162CHICAGC CEAF AND BLIND P^tOJECT 

19Q 796 163CIAC. € CLIN. SEP.. FOR ELEM. AND H.S. DEAF 

200 797 16<tSPECIAL ED. SERVICES CCNTIMjCUS PRCJECT 
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BEST COPY AVAILABLE 

CARD 

NUMBER ♦ CARC If^AGE C*^ 

201 793 165CEVEL. INCICATCKS FOR THE ASSES^ENT CF LEARNING (CIAL: 

202 739 193U £ R - SCHCGL COMM. lOENTI F ICATICN 

203 741 19^U t R - I N S TRLCT I C^aL TEA^ SCHCCLS 
20^ 766 l<;5lj £ R - CCVLLCP, APP« TO RtAO. 

205 78 .7807801*9LAr««ENCE H/iLL /RANDALL HALL 

2)6 7917«5179HA6CnK;^ECTI Vt A;4D RFMEU. READ. INST. 

207 796796163SUP^aEMeNT. EC. SE«VICE. FCR HANOI. 

206 7177177171C1LANGLAGF IN TRANSITION 

209 72416fcHC'''E VISITING I'nIST. TEAf^ PRQGR. 

210 726167CFNrER FOR ACC. LEARNING 

211 72916BCEVELCP. OF TEACH. STRATEGIES THRCLGH VICECTAPE „ 

212 731169CIAG.-PI5ESCKIP. APP, TO NEETING PIP. NEEDS 

213 73317-TEACH. PEAC. TH'^OLGH ORANA 

214 734171t:iAG.-PUESCR IP. APP. TQ REmcD. READ. 

215 736172HinH MCTIVATICN REAOING PRCGRAf _ ... 

216 73ei73HIGH NCTlVATIQr; REAIjING PROGRAf* 

217 74':i7'iU t k SCHCCLS - RESOURCE TEACHERS . 

218 * 7A219fcU t R SCHOOLS - QUID. FCR TITLE I cLEN. PUP. 

219 741197U £ R SCHCCLS - DEV. TEACH. STRATEGIES USE VICEOTAPE. 

220 743198U £ R SCHCCLS - COMPUTER ASSIST. INST. 

221 757175CRIENTATI0N ANC LANG. DEVEL. CENTERS... ^. 

222 766176INMRFCT CCST ALLCCATICN 

223 767177rMNI-GRAM U^^ITING CViN VY CC^y. READER... 

224 76817ef''Ifa-GUflNT FRIENC OF THE RcTARCEO READER 

225 769179^ INl-GRAf;T FCLDEN MOTO:? COOROINATICN LAB. . 

226 77818'. EARLY CHRCHCCC EOtCATICN 

227 792161HIGH INTENSITY READING CENTER 

228 ' 798182TUTuR U^L CRCPOLT PREVENTION ETHNICITY PRCGRAH 



CARU 



BEST COPY AVAILABLE 
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♦ CARD iMAGe 



1 


2fl4C107ll 


70C 




2 


185' li472 


6:5 




3 


268:i.)971 


725 






268 ;2J971 


725 


1 


5 


268. 31171 


725 




6 


268.^31171 


723 




7 


2b8u43372 


725 




8 


)85(.1'.<9 71 


745 


11 


9 


08 5;* 211 71 


74 5 


11 




085: 3'J372 


745 


1 


11 


616Mj372 


613 




12 


409 .10172 


6C11 




13 


4i:r 15172 


601 


1 


lA 


410-20472 


601 




15 


289.illl71 


697 




16 


289U20172 


6 CI 




17 


761. 11171 


697 




1& 


761. 21271 


686 




19 


7611 3:172 


6;i 




2C 


112- 10172 


601 




21 


699-,lv"'971 


745 


1 


22 


69 9 '.20 3 72 


745 




23 


18Cvlin72 


7C11 




2A 


101 l.n72 


6011 




25 


277^.104721 




26 


263l 1J971 


700 




27 


263; 2i:71 


791 




28 


263 , 30272 


638 




29 


263-4^272 


791 


1 


3L» 


274 '31^71 


757 




31 


274MC971 


7uC 




32 


274..2:'9/l 


7jO 




33 


214 1J172 


6011 




34 


20 5. 10172 


601 




35 


2l3v 10971 


791 




36 


21V2'.971 


725 




37 


210-.31J71 


725 




38 


21 j«.41171 


70 C 




39 


21C ;41171 


761 




40 


210: 50372 


741 




41 


2's:701J9 71 


717 




42 


207'w21271 


717 




43 


006', wl72 


6ri 




44 


004 '.1 J 172 


6011 




45 


004 '2J472 


6 J 11 




46 


760. 1)9 71 


716 


1 


47 


760^20272 


716 


1 


48 


555.. 10971 


638 




49 


154121w71 


703 




5C 


154131171 


7t31 


11 



1 
1 
1 

11 
1 



1 

1 1 



1 1 
1 



11 1. 

1 ■ 

1 1 



1 
1 
1 

11 
1 
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263 



BEST COPY AVAILABLE 



c ^ 


15h1hH f I 


1 J Sit 


1 1 








c ^ 

z>c 




/V J 


1 


1 












1 n 


1 

1 






C A 


15417^372 


7:: 31 


11 








55 


15418'J'«72 


7(.3 


1 i 
11 


1 

1 






56 


1541B0472 


7.0 


1 1 
11 


1 






57 


555C 31171 


638 










58 


122^- 1J472 


6C5 










59 


204c7J372 


638 










60 


204«.B.4372 


717 










61 


2O4011071- 638 


1 


... 








62 


20A' 6j172 


717 










63 


2n4v 41271 


717 




11 






64 


204i 51271 


717 




1 






65 


2t4» 21v71 


717 

717 


1 

M 








66 


^iy J .0*1 -171 

204 *31 J71 


71 7 

717 












271 *lJv71 













A. o 

oo 


271^ 2 j971 


7uU 




1 

1 


1 




69 


271', 31171 


7 




1 






7v 


271ioll71 


^ 1 c 

715 




1 






71 


149wll^71 


710 










IZ 


149-,.20172 


f^'-ll 










73 


149( 3J372 


7ir 




4 

1.. 







74 


203 »11171 


A 

697 


4 

1 








f 5 


201-1 )971 


638 






1 




76 


201'. 2v 3 >3 


638 










77 


253.. I>j971 


717 








1 Ji 


7o 


253.'21271 


689 




1 
1 






79 


253.31271 


717 




4 

1- 


^ 







253( 43172 


717 










81 


253 . 5'Jl72 


689 




4 
1 






82 


2 51011171 


AG"? 

697 


1 








83 


251'.-2n72 


697 




4 
1 






84 


246-1 j971 


725 


1 1 
11 






1 


85 


246nj971 


715 











86 


246''1J971 


791 








1 


87 


246. 1>971 


7wC 




1 






88 


246 '2i:71 


7# r- 

1 w v# 






1 




89 


246L.31171 


638 










90 


246:31171 


725 


1 

1 








91 


246i' 31171 


7CC 




1 

1 . 




1 . 


92 


24'? .10971 


70 C 


11 




I 


93 


24 J'..21'j71 


638 






1 




94 


24.Jv3lJ71 


731 






1 




95 


24 V:41071 


70 C 


1 


1 


1 


1 


96 


24j.:51l71 


638 










97 


247.61171 


700 




1. 






98 


240.70271 


725 










99 


24':v.8C2 71 


731 




1 




1 




24JC93271 


638 











1 

1 



1 

1 
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CARD 
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101 


235 <;1'J971 


7251 


1 


1 


102 


235*. 21171 


6 J8 


1 




103 


235''i31. 71 


725 






10^ 


235-41171 


725 






105 


235 .'51171 


638 






106 


235-61171 


725 






107 


235*70372 


725 






lOd 


235v8 )372 


725 


1 1 




109 


235-90372 


638 






llu 


235vl^ -372 


724 


1 




111 


234 ' 13472 


6051 






112 


124. 11171 


7 3 'J 


1 


1 


113 


552'.l'v!971 


73C 




1 


llA 


552w'21171 


73C 




11 


115 


552. 21171 


689 




1 


116 


227 j1u272 


6S81 




1 


117 


8C2. 1.J9 71 


732 


1 




118 


802^21171 


725 


1 




119 


802 i 31171 


t5A 


11 




12(. 


802. .40172 


6^1 






121 


8C2- 50372 


72h 






122 


802 6J372 


72h 






123 


654''1 J971 


7^3 


. 


. ... . 


124 


654vj210 71 


•» c 

725 






125 


654'-312 71 


70Q 






126 


654.43372 


724 






127 


660..'1 J971 


717 






128 


661- 21c71 


717 






129 


66J«. 30172 


717 






130 


66:)j40172 


717 






131 


242 : 109 71 


791 


11 




132 


242 20971 


7wC 


11 




133 


242 . 31171 


638 






13A 


242^41171 


725 


1 




135 


242.;'5J172 


638 






136 


242 . 6J172 


7uC 


11 




137 


242 7 372 




1 




136 


229i.>l j9 71 


"1 c 

72 5 


i 
1 


X 


139 


229;'2i:'71 


7C0 




1 


lAO 


229-: 31271 


638 






lAl 


229-. 41271 


700 






142 


229 J504 72 


7CQ 


1 




143 


22d ,1)971 


"T O C 


i 

1 




144 


225'-21'j71 


7C0 




11 


145 


22ii 31171 


628 






146 


225 -31171 


638 






147 


225. 31171 


7211 


1 


1 1 


148 


225 -31171 


725 




11 


149 


225'. 4D J72 


725 




11 


150 


2 25v.;40 3 72 


761 


1 





1. 



1 1 
1 



1 1 



CARD 
NUKBbR 



♦ CARD IMAGE 



151 28An0971 791 

152 284:10971 761 

153 28a:1C971 719 
15A 20AwlO971 70C 

155 284.21c71 721 

156 284 31171 721 

157 28Av 31171 761 

158 2841 31171 7911 

159 284211^71 791 

160 28A221171 791 

161 274^41271 653 

162 27<»:A1271 7:C 

163 274J41271 639 

164 274J41271 725 

165 274.50 372 725 

166 274 5:3372 791 

167 274- 50372 689 

168 274-.50372 653 

169 274- 5J372 7CQ 
llM 125->10172 6C1 
171 258^10172 6U1 



1 
1 

11 



1 
1 



1 
11 

1 

11 
1 
11 



1 
1 
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Mr. James G. Moffai 
Assistant S'jpcrintendent 
Government Funded Programs 
Board of Education, Crty of Chicago 
228 North l-aSalle Street, Room 1130 
Chicago, Illinois 60601 



Each time you use Guide to Program Audit , please complete this card and mail to address on 
reverse side. 

Did you find the answer to your question or concern in this handbook? Y es ^No 

If yes, please write your question in the If no, what should be included in this handbook to 
space provided. make it more useful . 



o 

ERIC 



If you found the answer in the hand- 
book, please note the page number. 
Page No. 



Please check if additional cards are needed. 

Mailing address: 



" Attachment #5 

A GUIDE TO PROGRAM AUDIT 267 
Evaluation Quesllonnalrg^g^ AVAILABLE 

Six months ago you were sent a copy of A Guide to Program Audit , a publication prepared by 
the Department of Government Funded Programs. Now that you liave probably had the opportunity 
to become familiar with the guide on program audit procedures, we would appreciate your 
comments regarding its usefulness and content and any suggestions that you feel would improve 
the manual . 

Place a check in the appropriate space for each item. 

BECAUSE OF THE GUIDE 
1 am able to approach this I can see immediate practi- 

task more effectively. cal application. 

About Does not About Does not 

Yes Same No Apply Yes Same No Apply 

1. Determining the role of the 
auditor during a school 

Visit. 

2. Determining if a program is 
being conducted according 

to guidelines as planned 

3. Determining the function of 

a program audit. 

4. Has the guide changed your conception of program audit? Yes No 

5. How often have you the guide in the past six months? 

6. How would you rate the quality of this guide? Superior Good Fair 

7. Which section has been most useful to you? Section # Why? 

8. Which section has been least useful to you? Section # Why? 

Additional comments or suggestions: 
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